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Foreword 


FOREWORD 


On November 21, 1974, the Honourable Jean Chrétien, President 
of the Treasury Board, announced that the Government planned to commission 


an independent study of its language training programmes. 


In the document tabled in the House on this occasion (Report 


on implementation of the Resolution concerning the official languages 
adopted by Parliament in Jume, 1973, p. 8), the Minister declared: 


While techniques for teaching second languages are 
well developed, little is known about the reasons 
why some people cannot learn. Because of the lack 
of experience in this area, a study will be carried 
out to determine why some persons appear to be 
unable to learn a second language. This study 
should contribute to a better understanding of 
learning problems and to the improvement of teaching 
methods. The results will be made available to 

the provinces and to other interested linguistic 
and educational organizations. 


On December 20, the President announced the appointment of a 
Director for the study and described the mandate that he had been 
given to recruit a team of experts to assist him in carrying out the 
study. This study would comprise, he wrote, "an examination of all 
factors related to the language training programmes of the Public 
Service" (Treasury Board, news release 74/68, December 20, 1974). 
Within the terms of the mandate entrusted to Gilles Bibeau, doctor in 
linguistics and associate professor at the Faculté des Sciences de 
1'Education of the Université de Montréal, "the study has as its 
objective to isolate from the global activity of teaching and learning 
in the Canadian Public Service those aspects which could be improved, 
corrected or adjusted to maximize the success of students who undertake 


language training". 


A research team was brought together for the planning and 
scientific supervision of the study. This team, in addition to the 


Director, includes: 


Henry P. Edwards, Ph.D. in psychology, Dean of the Faculty of 
Psychology of the University of Ottawa. 


i LbaGs, L'Institut de Formation par le Groupe, an 
organization specializing in psycho-social 
studies, represented by Yvon Rodrigue, Ph.D., 
coordinator of the Centre for Research and 
Evaluation of the IFG, and Francois Allaire, 
L.Ps. in Social Psychology. 


Raymond LeBlanc, doctor in linguistics, Director of the Centre 
for Second Language Learning and associate 
professor in the Department of Linguistics of 
the University of Ottawa. 


William F. Mackey, doctor of letters, Director - founder of the 
International Centre for Research on Bilingualism 
(CIRB), member of a number of Canadian and 
foreign governmental commissions on linguistic 
questions, professor at the University of 
Laval. 


Robert Tousignant, doctor of pedagogical sciences, Director of the 
Section for Testing and Evaluation and associate 
professor in the Faculty of Educational Sciences 
of the University of Montreal. 


Each of these persons, specializing in a different area, 
enjoys considerable prestige in his discipline. The complementarity 
of their respective interests guarantees a more balanced study than 


would be possible with greater homogeneity. 
Others working with this team include: 


Pierre Cardinal, M.A. in linguistics, research specialist at the 
Studies Division of the Staff Development 
Branch of the Public Service, as Assistant to 
the Director of the study. 

Michel Gilbert, Ph.D. in experimental psychology, professor at 

the University of Québec in Montréal, and 

Senior researcher at the IFG. 


Lorraine Lebeau, L.Ps. in psychology and affiliated member of 


the Centre for Research and Evaluation of the 
LEG, 


Frances Smyth, M.A. in psychology and research officer for the 
Ottawa Separate School Board, as research 
assistant to Henry P. Edwards. 


Marjorie Wesche, Ph.D. in applied linguistics (Educational 
Theory), of the Modern Language Centre of 
O.1.S.E. (Toronto), as research assistant. 


Numerous consultations have taken place with persons involved 
in the language training programmes and with the representatives of 
Public Service bargaining agents. Intensive meetings between the 
research team and these individuals allowed the postulation of a 
number of hypotheses which might explain the present lack of satisfaction 
with results obtained by public servant-students engaged in language 
training. The nature of the information gathered and the complexity 
of the problem led the team to eliminate out-of-hand the search for a 


single or principal cause. 


In fact, it has been possible to attribute a priori the 
difficulties encountered in the teaching and learning of the second 
language to a number of factors, which interact with each other within 


the global activity of language training: 


(a) Is the general structure which the Government has set up to 
apply the Official Languages Act and the Resolution adopted 
by Parliament (June, 1973) composed of mechanisms which are 
badly co-ordinated with each other, resulting in a lack of 


coherence? 


(b) Are the linguistic objectives differently defined and under- 


stood in different areas of the programme? 


(c) Is sufficient account taken of psychological and socio- 
psychological factors which affect individuals and groups 


undergoing language training? 


(d) Are the pedagogical and other means used to attain the 


objectives sufficient and adequate? 


(e) Do the evaluation mechanisms used accurately reflect the 


results obtained in terms of the expected results? 


The research team interpreted its mandate as a request for 
specific information on these subjects, and therefore decided to orient 
its research in these directions. The administrative, psychological, 
socio-psychological, pedagogical and testing dimensions have thus been 


painstakingly examined by specialists. 


RESEARCH GROUP A 


Analysis of evaluation mechanisms and 


instruments for language training 
(W. F. Mackey and R. Tousignant) 


Research Group A was concerned with analyzing the evaluation 
mechanisms and instruments used in language training. As such an 
evaluation could only be made in terms of the objectives of the language 
training, it was first necessary to carefully examine these objectives, 
and as a consequence to put into question the coherence of the entire 


system of language training in the Public Service. 


The system which has been established to apply the Official 
Languages Act rests on an interpretation of texts, declarations, and 
directives at different levels of the administrative structure. This 
interpretation in a sense constitutes the objectives of each level. Is 
this structure coherent? Are the objectives of each level shared by the 
lower levels? How is each organism related to the language training 
programme? Is the present organization of programmes the most economical 


possible, taking into account the objectives and the results obtained? 


We can also ask ourselves if the evaluation mechanisms preceding, 
accompanying or following language training are rigorously based on 
criteria of success which correspond to the objectives sought. Do the 


evaluation personnel charged with following the progress of students, 


and officially or unofficially confirming their success or failure, work 
in close collaboration to apply a coherent and logical policy at all 
levels of the system? Do the measurement instruments used from the 
beginning to the end of training have defined statistical characteristics 
and do they provide the information needed for adequate evaluation of 


the results obtained? 


RESEARCH GROUP B 


Individual psychological factors 
(H. P. Edwards) 


One can affirm with certainty that the learning of a second 
language is not dependent only upon the manner in which it is taught, 


and the material conditions within which the teaching takes place. 


In addition to pedagogical procedures one must consider the 
general attitude of the learner, his long-term and short-term motivation 
with respect to the second language, his intellectual and linguistic 
aptitudes, his self-concept, his fundamental personality traits, etc. 

It is usually said that such factors play a more important role than 


teaching methods in the learning and maintenance of language knowledge. 


The study of these basic factors and of their relative impor- 
tance in the prediction of success in continuous language training can 
without doubt clarify our understanding of the learning of second 


languages by public servants in particular, and by adults in general. 


RESEARCH GROUP C 


Psycho-social and psycho-pedagogical factors 
(L'IFG: Y. Rodrigue, F. Allaire, L. Lebeau, M. Gilbert) 


In addition to the more strictly "individual" psychological 
variables such as aptitudes, personality, etc., there exist psycho- 


pedagogical variables in second language learning and maintenance which 


Ee vGh es 


play a determining role in the language behavior of individuals who 
aspire to positions identified as bilingual. It is important to study 
these variables BEFORE, DURING and AFTER the public servant's language 
training in order to understand the conditions which encourage or 


discourage learning and maintenance of the skills learned. 


BEFORE his entrance in a language training programme the 
public servant finds himself in a work context which to a greater or 
lesser extent prepares him for learning the second language and supports 
him in this process. What are the most positive aspects of this organizational 
context? What are the most negative? Is it the support which the 
public servant receives from his superiors or his colleagues for using 
the second language at work? Is it the reinforcement in using the 
second language which he receives from those of the other language group 
with whom he converses? Is it the perceived usefulness of the second 
language for participation in the life of the Department, the Service, 


etc.? 


DURING his stay at a Language Training Centre of the Govern- 
ment, what elements of his psycho-pedagogical context help him the most 
in the learning process? Is it the degree of cohesion which exists 
within the small group of public servants with whom he learns the second 
language for a number of months? Is it the quality of his relationships 
with the teachers from the other language group or the pedagogical 
methods which they use? Which of these factors have the greatest 
influence and what are the variables (attitudes and motivations, etc.) 


which most affect them? How does a class evolve in the course of a 


typical month? 


AFTER his return to his work milieu, does the public servant 
use the second language which he has just learned? If yes, under what 
circumstances? If no, why not? Which elements of the organizational 
context in which he finds himself contribute most to this situation? 


What effect does the use he makes of the second language have on the 


maintenance of his newly acquired knowledge? 


RESEARCH GROUP D 


Pedagogical factors 
(R. LeBlanc) 


One often has the tendency to attribute to teaching and 
everything connected with it - the teachers, the pedagogical process, 
methods, working conditions, etc. - a primary importance in an operation 
which has as its objective the learning of something. While the impor- 
tance of these factors should not be exaggerated, one cannot deny that 
without a programme, a teacher, and regular meetings between the teacher 
and the students, learning is left to the sole initiative of individuals 
and to the only means which they may have at their disposal. A competent 
professor, a proven method, an environment that favours individual 
efforts and which channels them, constitute indispensable elements for 


the rapid and structured acquisition of new knowledge. 


A research project on language education which would not 
include a careful examination of pedagogical instruments used in teaching 


would be incomplete and senseless. 


RESEARCH GROUP E 


Complementary questions 


Certain other questions, also quite important, do not relate 
specifically to general structure, psychology, or pedagogy: they are 
related at the same time to different sectors, or are situated outside 
the immediate preoccupations of teaching. Their importance has to do 
with the fact that they can have considerable influence on the language 


training programme. 


These questions concern the pre-training orientation of public 
servants; students who drop out, withdraw or return to continuous training; 


special courses in the departments; research; pedagogical techniques; 


S10 = 


and possibilities for use and actual use of the second language in the 
departments. We have also studied other aspects of learning: attitude 
change, theories of learning, the experimental programme of suggestopaedia, 
documents from the Commissioner of Official Languages, and finally the 
work of various international centres, in particular UNESCO and the 


Council of Europe. 


The research programme of the Independent Study has thus 
included some thirty distinct researches planned to furnish relevant 
information of a descriptive nature on most questions, and of a pre- 
dictive nature with regard to certain aspects of success in learning the 
second language. The instruments used here have been described in 


detail and justified in the reports of each research group. 


The various research studies have been entrusted in some cases 
to independent research groups composed of experts, in other cases, to 
research groups internal to the Public Service, and in still other 
cases, by contract to individual external specialists. Considerable use 
has been made of the resources of the Staff Development Branch and the 
Office of the Coordinator of the Official Languages Programme of the 
Public Service Commission, as well as those of the Official Languages 
Branch of the Treasury Board, without impeding or endangering the inde- 


pendent (external) character of the Study. 


This research report constitutes the contribution of one of 
the research groups of the Independent Study. It is part of a set of 
studies carried out by various research groups. The conclusions of this 
research, together with those of the other studies, were the principal 
sources used in the preparation of a general report, which included a 
synthesis of the situation and specific recommendations concerning areas 
which could be improved. The general report and all the other research 
reports were submitted to the President of the Treasury Board and the 


Secretary of State of the Government of Canada by April 30, 1976. 


Gilles Bibeau 
Director of LTP Team 
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INTRODUCTION 


In the early stages of our research work, as soon as contact 
was made with language training officers working for the Government of 
Canada, we discovered that much criticism was being levelled at the 
language competence of candidates for bilingual positions with the 


Public Service. 


Now, in any training programme, the evaluation mechanisms and 
instruments play an important role. For this reason, it was decided to 
undertake a systematic examination of the mechanisms and instruments 
used in the Public Service of Canada to evaluate the language competence 


of officers required to work in both of the country's languages. 


To set our study within a broader theoretical framework, the 
first chapter will describe how the problem of evaluation forms part of 
a general training programme. This will enable us to identify the 


facets of the Public Service programme which will involve our analysis, 


that is: 
= the objectives of this training programme; 
- the evaluation mechanisms and instruments; 
- the Language Knowledge Examination (L.K.E.) given to many 
public servants attempting to qualify for a bilingual position. 
Sources of information will be given and our method of analysis 
described. 


Because so much material must be examined, the results of our 
analysis will be presented in three separate chapters; the second which 
will review the objectives of learning French or English as a second 


language in the Public Service; the third which will discuss evaluation 


eS, eee 


mechanisms and instruments and the fourth which will relate exclusively 


to the Language Knowledge Examination (L.K.E.). 


Our observations will reveal the framework of the policy 
applied to the evaluation of learning languages within the Public Service. 


This will be the subject of our fifth and last chapter. 


This report will thus comprise an introductory chapter, three 
analytical chapters of the situation and one in the form of a conclusion. 


These five chapters are presented as follows: 


Chapter 1: Defining the problem; 

Chapter 2: Analysis of the language training objectives; 

Chapter 3: Analysis of the evaluation mechanisms and instruments; 
Chapter 4: Analysis of the L.K.E.; 

Chapter 5: Conclusions relating to the evaluation policy. 


The time allocated to this part of the research did not permit 
inquiries in every section or sub-section of the Canadian Public Service's 
language training system. Nonetheless, we feel we have identified the 
principal aspects of the evaluation which have faults and need to be 


improved; this was the mandate conferred upon us. 


CHAPTER | 


Defining the Problem 


@. the 
; | PMS on aa a + 


é 

wane of) page - . a 
¢ = (ae LPs (pe: 
eq 7 < 


CHAPTER 1 
DEFINING THE PROBLEM 
In the first chapter, we shall see how the problem of evaluation 
should be approached. We shall then identify the elements of our analysis 
and describe the work method adopted. 


1.1. THE PROBLEM OF EVALUATION 


In the language training programme of the Public Service 
Commission of Canada, general characteristics to be found in any training 


programme and in other language training programmes should be discernible. 


In this study, then, our first concern is to consider how the 


problem of evaluation appears 


(1) in any training programme; 


(2) in a language training programme. 


1.1.1 Evaluation in a training programme, in general 


For most people, evaluate means "appreciate the value, the 
price, the importance of a thing" (Larousse). Thus, a property, damages 
involved in an accident, the profitability of a plant, and so on, may be 


evaluated. 


To evaluate a training programme is to judge its efficiency, 


the quantity and quality of the results produced. 


But an evaluation cannot be made emotionally, inclusively or 


intuitively; precise, concrete criteria, selected in advance, are needed. 
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Thus, the value of a property is established according to its site, its 
dimensions, the quality of the building materials, and so on... The 
profitability of a plant will be evaluated from the number and the 
quality of the machines manufactured, their performance, their market 


value against their production cost, and so on ... 


Evaluation of a training programme is also based on set 
criteria, that is, the objectives of this programme. To judge the value 
of a training programme, we must first ask how many persons are to be 
trained and in what areas competence is to be achieved; we must note 
whether the quantitative and qualitative results correspond to the fixed 


objectives. 


But if the evaluation of a property or the profitability of a 
plant is possible through direct observation of concrete criteria, the 
evaluation of a training programme is done chiefly through the indirect 


observation of criteria which are far more difficult to observe. 


In fact, what we attempt to evaluate in a training programme 
is the knowledge and competence acquired by persons who have benefited 
from this programme. But knowledge and competence cannot be easily 
observed; their scope, depth, quality and diversity can be measured only 
in terms of external changes. This is why the results of a training 
programme are evaluated through measurement techniques called tests or 


examinations which may take many forms. 


These instruments of measurement do not measure in the true 
sense of the word; they simply permit observation of the reactions and 
behaviour of persons who accomplish specific tasks and thus judge indirectly 


what they know and what they can do, that is, their knowledge and 


competence. 
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Evaluation is thus always a subjective and qualitative process. 
But to increase its validity and objectivity, data of systematic observation 
or the results of tests and examinations are required. Observation 
techniques and instruments of measurement supply the necessary information. 
In the light of these data, it is then decided whether or not the 
objectives of the training programme have been achieved by an individual 


or group. 
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A language training programme usually teaches a new language. 
The evaluation of a language training programme will therefore consist 
in assessing the extent to which those who complete it know the language 


studied and are capable of using it to communicate with other persons. 


The main difficulty in evaluating a language training pro- 
gramme arises from the fact that it is difficult to say what is meant by 
knowing another language. Learning a language is in fact a complex 
procedure which involves the acquisition of specific notions (vocabulary, 
grammar) and the development of various cognitive and psychomotor skills 
(reading, understanding, speaking, writing). Furthermore, knowledge of 
vocabulary, phrase structures and grammar rules do not necessarily 
correspond to the ability of communicating in a foreign language. In 
general, it is therefore difficult to say what is meant by knowing a 


language. 


In short, we have to be more specific. If we want to evaluate 
especially the product of a language training programme, we must first 


specify learning objectives in great detail. 


The analysis of students' needs permits logical identification 
of the skills which such a programme should develop and the language 
competence that it should achieve, and therefore determine clear and 


interesting learning objectives. 
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In fact, it depends whether a student takes up a new language 
in order to read easy or more difficult texts or publications, to travel 
occasionally or regularly in a foreign country where that language is 
spoken, or to work in that language every day at easy or difficult, 
simple or complex tasks; language content and specific levels of skill 
will be chosen accordingly, to become concrete objectives of the training 
programme. It will then be possible to devise instruments of measurement 
which can gauge the extent and depth of knowledge acquired, the nature 


and quality of skills developed. 


In a language training programme, we must first and foremost 
identify students’ needs, and then determine learning objectives as a 
function of their real needs. These objectives then become the basis of 
a whole training programme and form the main criteria for student 


evaluation. 


Naturally, all the aspects of a training programme and the sum 
of all parts of this programme may also form the subject of the evaluation. 
The objectives set forward may be realistic or utopian, modest or ambitious; 
the personnel may be qualified or incompetent, conscientious or negligent; 
teaching equipment may be adequate or inadequate; training methods used 
may be modern or archaic, productive or ineffective, and so on. But, 


finally, what really counts in evaluation is the quality of results according 


to fixed objectives. 
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1.2 THE ELEMENTS OF OUR ANALYSIS 


The elements of the language training programme for federal 
public servants which we must analyze are now easy to identify. Since 
we wish to analyze the mechanisms and instruments involved in this 


training, two questions arise spontaneously: 


= what should public servants using the second language know and 
how can they become capable of using this second language in 
performing their duties in keeping with Government requirements 
so as to satisfy both the spirit and the letter of the law as 


expressed in the Official Languages Act? 


= in what manner and with what instruments of measurement may we 
evaluate the acquisition of knowledge and skills needed to 
become bilingual in the Public Service. In other words: (1) 
What are the language training objectives of these public 
servants? (2) To what extent is the evaluation of their 


language competence a function of these objectives? 
Our analysis will thus fall into three distinct parts: 
= analysis of language training objectives; (Chap. 2) 


= analysis of the evaluation mechanisms and instruments; 


(Chap. 3) 


= analysis of the language knowledge examination, L.K.E. 


(Chap. 4) 


In concluding the study, we shall give a brief overall assess- 


ment of the Public Service's language training programme. (See Chap. 5) 
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1.3 THE WORK METHOD ADOPTED 


Having never had any relations whatsoever with any federal 
Government agencies, we have dealt with our work without any prejudice 
and adopted a relatively simple work method. In the first place, we 
tried to obtain as much information as possible relating to the objectives 
of the federal Government's language training programme, the evaluation 
mechanisms and instruments used in the Public Service. We then examined 
the data collected in the light of the principles of measurement and 
evaluation in education found in the serious works dealing with these 


questions. 
We found the necessary information: 


= by studying the official documents of the Treasury Board and 


the Public Service available in 1975; 


= by questioning well-informed persons more or less closely 


involved in the process of evaluating language teaching; 


= by examining data compiled by other groups associated with 
this project for research into the Public Service's language 


training programmes; 


= by analyzing the instruments of measurement presently used 


before, during and after learning the second language. 


Of the works which provided us with the theoretical framework 
for this study, that of Benjamin S. Bloom, J. Thomas Hastings and 
George F. Madaus deserve particular mention since they summarize the 
thought of many authors concerning the measurement and evaluation of 
learning results, including a chapter on evaluation of the process of 


learning a second language. This outstanding work is called Handbook on 
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Chapter 22, written by Rebecca M. Valette, Evaluation of Learning ina 
Second Language (40 p.). 


As was to be expected, the documents studied and the persons 
questioned did not provide answers to all our questions with the degree 
of accuracy we would have wished. Thus, today, we shall not claim to 
have compiled all possible information and describe the situation as it 
was ten years before, as it has developed and as it appears today. We 
simply used, to the best of our knowledge, the information collected to 


produce an analysis intended to be logical and objective. 
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Analysis of Objectives in the 
Public Service Language 
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CHAPTER 2 


ANALYSIS OF OBJECTIVES IN THE PUBLIC SERVICE LANGUAGE 
TRAINING PROGRAMME 


As previously observed, the objectives of a language training 
programme affect all aspects of this programme since they justify the 
content of courses and learning methods and provide criteria for evaluating 
the results obtained. It is therefore important to define these objectives 


clearly and accurately so that their basis may be perceived. 


But there is always a hierarchy linking the objectives of a 
training programme, some relating to the programme as a whole, others to 
its more important aspects, others to details. It is important to 
recognize this hierarchy and the internal coherence which must connect 


one objective to another to produce a harmonious and functional whole. 


This prompted the authors of the training programmes and 
specialists in measurement and evaluation to produce certain rules for 


classifying objectives and propose frameworks for classification which 


were called Taxonomy of Educational Objectives’. 


Without concerning ourselves too much with such rules and 
classification frameworks, we may at least note that most objectives in 
a training programme fall within a continuum proceeding from the entirely 
general to the absolutely specific and that they may be grouped according 
to their nature in three major categories: cognitive objectives, affective 
objectives, psycho-motor objectives. Thus, in the Public Service's 


language training programme, we may consider that "training bilingual 


Benjamin S. Bloom 


Taxonomy of Educational Objectives 
New York, David McKay, 1956, 196 p. 
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public servants" is a general objective; but "providing bilingual 
services for the Canadian public" is still more general. "Teaching 
public servants to express themselves correctly in writing in the second 
language" is again more specific, less general. 'Teaching how to 
formulate and apply the past participle conjugated with the auxiliary 
avoir'' becomes more specific. "Acquiring a basic vocabulary, learning 
grammatical rules" are cognitive objectives which relate to the intelligence, 
memory, intellectual faculties. ''Developing an interest in studying the 
second language'' is an objective of the second order relating to a more 
profound change in the learner's personality. "Learning correct 
pronunciation, to speak with a natural rhythm and accent" are psycho- 
motor objectives which means that muscles of the phonatory system must 


be used. 


To analyze the objectives of the Public Service language 
training programme, we shall in fact try to distinguish general objectives 
and the more specific objectives while emphasizing the importance of 
objectives of an emotional nature often neglected in favour of cognitive 


and psycho-motor objectives. 
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2.1 GENERAL OBJECTIVES OF LANGUAGE TRAINING 


The language training programme of federal public servants 
results directly from the policy gradually developed since 1963 and made 
official by the Official Languages Act of Canada on July 9, 1969. The 
general objectives of the language training programme were thus originally 
merged with those of language policy and then with methods of implementing 
that policy. Now, the objectives of this policy are quite clear and the 
measures taken to apply it concretely are easy to describe, even if they 


are not always easy to justify. 
To understand the objectives which concern us, we may therefore 


first try to see (1) how they appear in their present form and (2) how 


they have been defined. 


2.1.1 How they appear 


Three levels of general or fairly general objectives may be 


recognized without difficulty: 


= the objectives of language policy considered overall; 


= the positions which have been designated bilingual and are to 


become exclusively bilingual; 


the language requirements of these positions. 


“11.1 Policy objectives 


These objectives appeared at an early stage in official government 


documents as, for example, in the House of Commons debates for the month 
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of May 1963, where the principle of perfect equality of the two official 
languages in verbal and written communications with the public and 


: Z 
within the departments was recognized . 


A statement made in the House of Commons by Prime Minister 
Lester B. Pearson in April 1966, clearly expresses the Government's 
desire to recruit and train bilingual public servants to set up its new 


language hoioy 


After acceptance by Prime Minister P.-E. Trudeau of the Laurendeau 
Commission's recommendations in October 1968 and promulgation of the 
Official Languages Act in 1969°, the Government's intentions became even 
more explicit and finally, in December 1972, the President of the 
Treasury Board presented the objectives of the federal Government's 
language policy in unequivocal terms. Here, we refer to the Hon. C. M. Drury's 


document: 


"The Government's bilingualism policy is based on the premise 
that the right of English-speaking Canadians to use English 
and the right of French-speaking Canadians to use French must 
be protected. In terms of general policy, this means that a 
citizen should be able to deal with the Government of Canada 
in his own language and work for his Government in his own 
language. To achieve this objective, the Government has drawn 
up two policies: firstly, Canadians should be able to 
communicate with the federal Government and benefit from its 
services in the language of their choice, English or French. 
This means that in English-speaking areas, the Public Service 
must provide services for the public in English and that in 
French-speaking areas, the Public Service must provide services 
in French. In regions where both languages are used, whether 
in the National Capital Region, bilingual areas, or other 
regions where there is considerable demand for bilingual 
services, the Public Service must provide services for the 
public either in English or in French, as each citizen desires. 


See House of Commons, May 1963. 
N.B. All official documents mentioned in Chapter 2 are listed in 


Annex 1: The development of language policy in Canada. 


3 

See Pearson, April 66 
4 

See Treasury Board, October 66 
5 


See Official Languages Act, July 69. 
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Secondly, Canadians in the service of the Government of 

Canada should, as a general rule, be able to work in the 
language of their choice. This equality of opportunity will 
exist in cases where supervision of employees and the common 
services they require, such as personnel services, will be 
provided in both languages. Regions where this supervision 
and these services may be provided in both languages will 
include the National Capital Region and any other region where 
both languages are in fairly common use, both in Government 
offices and in the community generally. Taking into account 
the present geographical distribution of English-speaking and 
French-speaking Canadians, those regions would at present 
include places such as Montreal, some other parts of Quebec, 
some parts of Eastern and Northern Ontario and some parts of 
Northern and North-Western New Brunswick. The Government has 
not as yet set a time limit for full implementation of this 
policy but at present it seems realistic to expect the desired 
results by 1978." (Trans. )°6 


There is no need for further discussion of the federal Government's 


objectives in language policy. 


2sinlee bidaneual positions inethe Public Service 


To enable Canadians to benefit from bilingual services and 
federal public servants to work in the language of their choice, the 
Government early undertook the task of introducing bilingualism in its 
own services and setting up a bilingual Public Service. A statement 
made by Mr. Pearson in 1966 gave clear expression to the Government's 
ambitions in the question of bilingualism in the Public Service. He 


said: 


"In a diverse federal State such as Canada, it is important 

that all citizens should have a fair and equal opportunity to 
participate in the national administration and to identify 
themselves with, and feel at home in, their own national 
capital. The Government hopes and expects that, with a 
reasonable period of years, a state of affairs in the Public 
Service will be reached whereby: (a) it will be normal practice 
for oral or written communications within the Service to be 

made in either official languages at the option of the person 


: See Drury, Dec. 72. 
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making them, in the knowledge that they will be understood by 
those directly concerned; (b) the linguistic and cultural 
values of both English-speaking and French-speaking Canadians 
will be reflected through Civil Service recruitment and training; 
(c) the linguistic and cultural values of both English-speaking 
and French-speaking Canadians will be reflected through Civil 
Service recruitment and training; and (d) a climate will be 
created in which Public Servants from both language groups 

will work together toward common goals, using their own 
language and applying their respective cultural values, but 
each fully understanding and appreciating those of the 

other.'"7 


Could the future of bilingualism in the federal services be 


described in more optimistic terms? 


But statements of intention are scarcely enough. There was an 
immediate move to identify positions in the Public Service where knowledge 
and use of both French and English proved necessary to satisfy requirements 
of the law and the necessities of services supplied by a bilingual 
Public Service. Since this operation did not progress swiftly enough 
the Treasury Board set time limits and determined the percentages of 
bilingual employees (Anglophone or Francophone) which should be found at 
different levels of the Public Service. Thus, in 1971, the Chairman of 
the Treasury Board stated that for 1975, in the National Capital and in 


the bilingual districts, percentages of bilingual employees would be as 


follows: 


- Executive category 602 
- Administrative and foreign service category 50% 
- Administrative support category 35% 
= Scientific and professional category 152% 
- Technical category 15% 
- Operational category 152° 


u See Pearson, April 1969. 
@ see Drury, March 1971. 
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In December 1972, that is, 21 months later, the same President 
of the Treasury Board announced that the departments would be asked to 
identify the bilingual positions of their different services for December 31, 
1973; and to guide them in the work of identifying these positions, he 
estimated at 100,000 approximately the number of positions in the Public 
Service in those regions where French and English are in current use and 
at 25,000 approximately the number of those who could be classified as 
bilingual. The Departments were then given five years to "designate" 
these positions as bilingual, that is, to find bilingual incumbents for 


ae 2) 
these positions . 


In June 73, a Treasury Board circular supplemented earlier 
directives and listed positions where positions should be identified as 
bilingual to serve the public in the two official languages and ensure 


the use of those same official languages within the Public Sela 


Following this vast undertaking in which bilingual positions 
were to be identified and designated, the Hon. Jean Chrétien, the new 
President of the Treasury Board, published on November 21, 1974, a 
report which established the situation regarding bilingual positions on 
that date. In the Public Service as a whole, 169,576 unilingual English 
positions, that is, 60%, had been identified; 53,584 bilingual positions, 
that is, 19%; 35,566 unilingual French positions, that is, 13%, and 
22,938 convertible positions, that is, 8%, where the use of French or 


English is equally cae les 


2.1.1.3 The language requirements of these positions 


It was not enough to set as an objective finding bilingual 


incumbents for bilingual positions; there would have to be a statement 


, 
10 
if 


See Drury, December 72. 
See Parliamentary Resolution, Circular 1973-88, June 73. 


See Chrétien, November 74. 
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on what type of language knowledge would be required from each public 
servant. This was clear to the Government, as is shown by this extract 


from Circular (1973-88) of the Treasury Board: 


"Finally, in identifying positions as bilingual, it should be 
recognized that different levels of bilingualism will be 
required for different positions. In some positions, for 
example, it will mean only an ability to deal with simple and 
straightforward questions in the two official languages; in 
others it will mean an ability to understand the other language 
well but speak it only fairly well; in others it will mean an 
ability to speak, understand and write both official languages 
as commonly used; in still others, probably very few, it will 
mean a greater capacity to speak and understand both common 
and technical languages. The Public Service Commission in 
consultation with Departments, will determine the level of 
language knowledge required for individual positions."12 


Upon completion of consultation with the Departments, four 
basic skills in language competence were distinguished and four levels 
of competence set up in each. The four skills in question are: ability 
to understand the language spoken, ability to speak that language, 
ability to read the written language and ability to write that language. 
The four levels of bilingualism are level 01, the highest, the intermediary 
levels 02 and 03 and minimal level 04. Two other levels were later 
established, level 99 for specialized skills and level 77 for supervisory 


positions within a unit working in French (UWF). 


Table E.1, taken from the Official Languages Administrative 
Standards Manual gives an idea of the classification of bilingual positions 
by category and levels obtained in that manner. The same official 
manual also describes the procedures to be followed to establish language 
standards for bilingual positions, definitions of the four basic language 
abilities, illustrated with concrete examples, and descriptions of 


tasks which may be performed by public servants at different levels of 


bilingualism. 


A See Treasury Board, 1973-88. 
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TABLE E.1 


LEVEL OF LANGUAGE KNOWLEDGE 
AND CORRESPONDING NORM OF 
THE LKE BY EMPLOYMENT 
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TABLEAU E.1 


NIVEAU DE CONNAISSANCE 
LINGUISTIQUE ET NORME 
CORRESPONSANTE DE L’ECL 


PAR CATEGORIE D’EMPLOI ET 
GROUPE D’OCCUPATION 


CATEGORY AND OCCUPATIONAL GROUP 


SCIENTIFIC 
ADMINIST. AND 
SERVICES SUPPORT PROFESSIONAL TECHNICAL 


ADMINIST. SOUTIEN SCIENTIFIQUE TECHNIQUE 


EXECUTIVE 
DIRECTION 


ET SERVICES ADMINISTRATIF Eq 
EXTERIEURS 


PROFESSIONNEL 
NIVEAU ET NORME 


01 LKE Administra- 


(MAXIMUM) tors-scorers 
Administrateurs- 


correcteurs de 


LKE/ECL 400B 


LKE/ECL 400B 


04 
(MINIMUM) 
LKE/ECL 400B 


SPECIALIZED SKILLS 
COMPETENCES PARTICULIERES 


OPERATIONAL CATEGORY (POSITIONS REQUIRING LISTENING AND SPEAKING ONLY) 
CATEGORIE DE L‘EXPLOITATION (POSTES EXIGEANT SEULEMENT LES HABILETES 
LKE/ECL 400B | COMPRENDRE ET PARLER) 


AMENDMENT/MODIFICATIF 
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2.1.2 How they were defined 


The objectives of language training in the Public Service as 
we have just presented them appear quite attractive. There are bilingual 
positions to be filled. If bilingual personnel can be recruited or 
trained the problem will be solved. The language training programme 
will thus have the objective of training bilingual persons who will, at 
four levels of competence, master the four basic skills of the second 


language. 


But when all bilingual positions have bilingual incumbents, 
will the Public Service have become truly bilingual? Yes, if identification 
of these positions and assigning of levels of bilingualism to each of 
these positions meet real requirements and if bilingual public servants 
truly use both languages to meet the needs of their daily tasks. No, if 
results are unrealistic, if levels of bilingualism do not meet real 


needs. 


A closer examination of how the positions are identified and 
how levels of bilingualism assigned to each of the positions leads to 
the question of whether these positions and these levels translate the 


actual needs which were to be met. 


2.1.2.1 Positions and needs 


We cannot make an in-depth study of these fundamental questions 
within the limited framework of this research because the official 
documents do not tell the whole story and we have conducted no inquiry 
within the Public Service to clarify them. A large volume of evidence 
from persons who have followed development of bilingualism in the Public 
Service during recent years nonetheless permits us to form the opinion 
that identification of bilingual positions is unrealistic and assigning 


levels of bilingualism mandatory. 
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After all, it is of no great surprise for it was very 
difficult to take inventory of all the language needs of the Public 
Service, those which resulted from the actual necessity for serving the 
population in both languages of the country and those which resulted 
from the Government's desire to reflect in its own services the proportion 
of Anglophones and Francophones making up the bulk of the Canadian 
population. On the one hand, Departments were asked to identify positions 
as a function of known needs, on the other it was suggested that targets 


should be set in distribution of bilingual and unilingual positions. 


The needs to be satisfied were thus presented in two forms: 


needs which could be called legal, and language needs as such. 


The first stem from the Official Languages Act which obliges 
the Government to offer bilingual services in specific locations: In 
the National Capital, in bilingual districts, in foreign countries; and, 
if conditions require it, in head offices, in contacts with the travelling 
public, and where there is obviously heavy demand. The second depend 
whether populations are bilingual or unilingual. Now, the legal and 
language needs of any population in particular may easily not coincide. 
How, then, can it be decided how many bilingual positions will be needed 


to satisfy both types of needs? 


Without more specific criteria than those supplied by the law, 
it was difficult to analyze these needs. For example, what is meant by 
offering bilingual services "in major offices" within bilingual districts 
or "when there is considerable demand" outside those districts? What 
criteria should be used to calculate the number of persons in an official 
minority who truly need the services offered in the language of that 
minority? It is not only the language spoken at home which determines 
real needs but also the language used in school and at work by this 


minority. 
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Once there has been a priori determination of the proportion 
of positions which should be bilingual, the co-operation of one hundred 
and sixty Departments and services was requested in identifying bilingual 
positions and thousands of local managers had to decide about the linguistic 
composition of their environments and the frequency and importance of 
demands for bilingual services to determine the number of positions which 


should be labelled bilingual. 


Is it surprising that the identification of thousands of positions, 
by thousands of different persons, using more or less imperfect criteria, 


lacks objectivity and, in many cases, realism? 


2.1.2.2 Requirements and levels of bilingualism 


The situation is complicated by the fact that it is not enough 
to identify bilingual positions, each must be assigned a level of bilingualism 
corresponding to the language requirements of the needs to be satisfied: 


OL; (02, 03,,.04, and so on +... How was this to .be donez 


We would have liked to find out. Unfortunately, the official 
documents which we consulted shed no light on the subject, and the 
fragments of information supplied as explanation by public servants did not 
really dispel anxiety. Be that as it may, if we interpret correctly the 
information so laboriously collected, the course of events has been more 


or less as described below. 


Since we were trying to meet the needs of a Public Service 
which was to be made bilingual, we needed to attempt a systematic analysis 
of thousands of tasks using specific criteria and uniform methods. 
Since the proposal was to serve the population according to needs in the 
country's two official languages, it was also necessary to list methodically 
the real language needs of that population. Now, since these studies 
represented a vast, time-consuming and complicated task, shortcuts were 
taken which would permit a more rapid implantation of bilingualism in 
the Public Service of a certain form of bilingualism, courses which we 


now regard as regrettable. 
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In fact, instead of taking a realistic basis and analysing the 
type of skills a public servant would need to perform his duties in the 
second language, those responsible studied the behaviour of bilingual 


public servants who were already in bilingual positions. 


The method used sought to establish the relationship existing 
between the level of language knowledge of a number of bilingual public 
servants and the results of a language test, the 400A test, which claimed 
to measure their mastery of the second language in the four basic skills. 
Through questionnaires, the immediate supervisors of 12,000 bilingual 
employees in 23 Departments provided a description of the minimal language 
requirements for incumbents of bilingual positions who could perform 
competently. In order to obtain specific, uniform information, each 
supervisor was equipped with a document which described ten levels of 
mastery of each skill, ranging from "no competence at all" to "capacity 
to read, understand, speak or write anything at all in the second language". 
Between these extremes, intermediary levels were described, such as: 
“ability to read newspaper headlines, to write a letter, follow a discussion 


and express simple phrases". 


Test 400A was then given to those 12,000 bilingual public 
servants and a scale of concordance obtained between the results obtained 


in test 400A and the requirements described by the supervisors. 


This was done by dividing the 26 points of the test into five 
levels, 01, 02,.089704-20552and*caleulating: the average sconesor bach 
public servant in the set of four sub-tests in test 400A. By comparing 
the levels assigned by the supervisors and the levels corresponding to 
the results of the test, it was possible to classify, in levels, the 62 
types of employment represented in this sample of public servants and 
describe the language requirements stipulated at each level, of which 
there were five. Since this was an objective test, and multiple-choice 


jtems meant that chance was involved, the lowest level, level 05, was 
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subsequently suppressed, because the corresponding score could be obtained 
through random response to the questions in the test. This fifth level 
was finally replaced by level 22 which represented only the minimum 


requirements of two of the four basic skills: understanding and speaking. 


The first study was followed by another similar one which made 
it possible to classify in the same manner 18 categories of employment 
in 13 Departments; except that this time, the incumbent was simply asked 
to indicate the level of bilingualism at which he would place his abilities. 
By analogy, all the positions identified as bilingual in Departments 


which had not participated in these two studies were finally classified. 


Thus the bilingual positions were identified and their language 
requirements determined. From that time on, the objectives of language 
training consisted in assisting incumbents of bilingual positions or 
candidates appointed to bilingual positions to acquire the competence 
corresponding to the level of bilingualism assigned to the position in 
question. If the position should prove to be truly bilingual and meet 
genuine needs, so much the better; if not, the public servant who had 
worked to master the second language would continue to use only his 
mother tongue and that niche in the Public Service would be no more 
bilingual than it had been before. If the level of language competence 
indicated for that position sufficed to serve the population adequately 
or to work effectively with colleagues in another language, so much the 
better; otherwise, the public servant would not be abreast of the 


situation and his bilingualism would not be very effective. 
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2.2 SPECIFIC OBJECTIVES OF LANGUAGE TRAINING 


If the general objectives which we have just examined provide 
a good definition of the Canadian Government's language policy, they do 
not give an adequate description of the language training programme 
intended for federal public servants. We must now analyze the specific 
objectives of that programme to see what language skills these public 
servants are expected to acquire and then in what manner the results of 


the training which they have received may be evaluated. 


Since this notion of specific objective is relatively new for 
many officers in education or training, we shall immediately specify 
what we understand by that expression and we shall then see how the 
specific objectives of learning in the Public Service's language training 


programme are presented. 


2.2.1 What we mean by a specific objective 


At the beginning of Chapter II we mentioned that the objectives 
of a training programme may be set in a continuum going from the very 
general to the very specific and pointed out that "training bilingual 
public servants" describes a very general objective, that "teaching them 
to express themselves correctly in the second language" represents a 
more specific objective (although still fairly general) and that teaching 
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them to "understand and apply the rule of the past participle conjugated 


with avoir" may be considered a completely specific objective. 


Basically, all the objectives of a training programme may be 
considered as changes which are to be produced in students involved. 
When these changes are described in general terms, a general objective 
is conceived; when they are described in specific terms, they are called 


specific objectives. 
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It is important to define the objectives of a training programme 
in general terms and in specific terms. Indeed, the former give the 
general orientation of the programme, the overall result of the training 
envisaged. The latter provide the content of the courses and practical 
work, the basis of planning instruction and learning and the specific 


criteria for evaluating the result of the learning process. 


Thus, general objectives and specific objectives complement 
each other without providing contradictions, in the sense that some 
include all specific objectives and others specify in concrete and 


operational terms the direction of the general objectives. 


2.2.2 How the specific objectives of the Public Service's 
language training programme are presented 


The Public Service's language training programme, as we have 
seen, is intended to train bilingual public servants to occupy the 
positions identified and designated as bilingual. In fact, these public 
servants must acquire four basic skills, namely, reading comprehension, 
written expression, listening comprehension, oral expression. In addition, 
it was agreed that four levels of skill should be distinguished in each 
of these areas, namely levels O01, 02, 03, 04. To express these objectives 
in clearer, more specific terms, it was immediately understood that the 
sixteen basic skills would be defined in terms of actual behaviour. The 
following definitions were therefore proposed, accompanied by appropriate 
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examples: 


Language skills 


Reading comprehension: 


This skill makes it possible to grasp the sense of written 


texts directly related to the tasks to be accomplished. 


i 
° See Annex E of the OLAS Manual 
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Examples: Reading minutes 
Reading reports and letters 


Reading texts and articles 


Written expression: 


This skill makes it possible to prepare texts directly related 


to the tasks to be accomplished. 


Examples: Preparing telephone messages 
Preparing letters 


Preparing memoranda 


Listening comprehension: 


This skill makes it possible to understand the language spoken 


at work. 


Examples: Understanding what is said at a meeting or conference 
Understanding oral directives 


Understanding questions asked over the telephone 
Oral expression: 
This skill gives oral expression. 
Examples: Giving exact directives 
Explaining work in a general manner or in relation 


to a programme underway 


Giving information over the telephone. 
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By pushing specification of objectives somewhat further, we 
attempted, in similar fashion, to describe as behaviour the four levels 
of each of these skills. For skill in speaking (oral expression), for 


example, the following descriptions were found: 
Level 04: 


The position requires the ability to express oneself in isolated 
words, expressions of two or three words and simple, disconnected 
phrases. For example, greetings, taking leave, simple requests and 


other expressions required by courtesy in social situations. 
Level 03: 


The position requires the ability to express oneself in simple, 
interconnected phrases, and in well-constructed, complex sentences 
(each used separately). For example, making requests for information 
and replying, receiving and giving instructions, discussing needs 

and expressing opinions within the limits fixed in the first sentence. 
At this level, it is necessary that supervisors be able to assign 


work and explain activities in simple terms. 


The vocabulary is limited to common usage, not technical terms. 
The rate of speech is slower than normal and there may be hesitancies 


due to the influence of the mother tongue. 


Level 02: 


The position requires the ability to express oneself using the 

three types of sentences mentioned in 03, with transitions. Here, 
for example, there is the question of expressing opinions, expressing 
ideas and commenting on activities using non-technical terms, to 

take part in meetings. Mastery and richness of vocabulary are 
adequate to sustain a spontaneous, prolonged discussion. However, 


the ability to present a report from a prepared text is required. 
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In certain cases, the rate of use may approach normal, but will 
generally be somewhat slower. Pronunciation still includes faults 
due to the influence of the mother tongue. At this level, it is 
necessary for supervisors to assign work, explain activities and 


settle differences within the section. 
Level OL: 


The position requires the ability to express oneself in various 
types of interconnected phrases. At this level, it requires the 
ability to take part in meetings, discussions or briefing sessions 
of a general nature relating chiefly to work schedules, budgets, 
general managerial and administrative methods. It will also be 
necessary to present reports by using notes or reply spontaneously 
to questions relating to these reports. At this level, it is 


necessary for supervisors to preside over meetings. 


Generally speaking, the rate of delivery will be near normal. 
Pronunciation may clearly be that of a "second language" but will 
not be seriously marred by sounds from the mother tongue, naturally 


taking into account many individual variations 


It is therefore clear that the objectives of the Public Service's 
language training programme are naturally presented in the form of 
various language skills which take concrete expression in a whole range 
of observable modes of behaviour. It therefore appears logical to find 
these objectives as the basis of the Language Bureau's training programme 


and evaluation of language learning. 


Now, it does not seem that those reponsible for developing 
programmes and methods for teaching languages should have taken into 


account these language requirements at the time when they were preparing 


Lf See Annex E of the OLAS Manual. 
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the didactic material needed in language schools. In fact, they had to 
begin their work even before details of the OLAS manual were published. 
Obviously, they were given objectives to be achieved: listening 
comprehension, reading comprehension, written expression and oral expression. 
But nothing indicates that their definitions of these skills should 

agree with those of the OLAS manual which we have just described. On 

the contrary - it seems that a general definition of language skills was 
taken as a basis for developing one single method for all categories of 
public servants, assuming that they would gradually acquire the necessary 


skills and would progressively master each field of learning. 


In fact, the specific objectives for learning in the Language 
Bureau appear in terms of content (elements of language and sentence 
structure) and general skills of comprehension, and application of these 
elements and structures. As an example, we shall reproduce below a 
taxonomic grill of content and objectives of a performance test given to 
a student who had completed lessons 1 to 7 of the Dialogue-Canada 


method. 
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TABLE 1 


2-profile TAXONOMIC GRILL 


Re 07. DCL 


2:00 
COMPREHENS LON 


S00) 
APPLICATION TOTAL 
Z, 


*Z220 


SPECIFIC ELEMENTS: 


possessive adjectives 14 

- personal pronouns, acc. 14 
- personal pronouns, compl. 12 
- personal pronouns, emph. 5 
- interrogative expressions 10 
- syntagms 7 
- time expressions 6 
- vocabulary 2 
- verbs: present ind. i4 
imperative 6 

- prepositions 3 
- negation 3 
- articles 2 
- the clock 2 


TOTAL by category 


*2:10 transposition 
*2:20 interpretation 


Bloom Taxonomy 
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The following table illustrates progressive mastery of the 
four fundamental skills using the 45 lessons of the Dialogue-Canada 


method. 


TABLE 2 


Overall view of the Dialogue-Canada course 


Skills 


(106-7) 
(8 to 15) 
C16 t6 22) 
(23 t6 30) 


Cl £6: 45) 


Examination of these two tables shows us that on the one hand, 
the content of the Dialogue-Canada course comprises totally specific 
notions distributed in 45 well-determined lessons; on the other hand, 
that the whole formed by these lessons constitutes the primary material 
of the four basic skills which are gradually to be developed: listening 
comprehension (L.C.), reading comprehension (R.C.), written expression 
(W.E.) and oral expression (O.E.). It is quite clear, too, that the 
authors of this method placed an emphasis on two skills: listening 
comprehension and oral expression and that they allowed mastery of 


written expression to receive much less attention. 


At this point, we do not wish to criticize their method of 
selecting priorities, but simply to point out that these objectives do 
not correspond to the four levels of bilingualism specified in each of 
the areas of skill described in the OLAS Manual. To the contrary, it 


seems that the objective is to provide a basis common to all instruction 
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of French as a second language and develop general skills situated just 
above what could be called the threshold of bilingualism. Upon completion 
of the 45 lessons in Dialogue-Canada, if the tables are interpreted 
properly, students should understand, read and speak French just enough 

to say that they are bilingual but certainly not enough to say that they 
have mastered the four basic skills as described in language requirements 


at level Ol. 


Bi 


wares) Objectives of an emotional nature 


So far, we have disregarded objectives of an emotional order. 
However, learning a second language does not consist merely in knowing 
the elements and structures of a language (cognitive objectives) and 
manipulating these elements and structures (psychomotor objectives) to 


communicate orally. 


Almost all language teachers in fact recognize the importance 
of attitudes and motivation in this type of learning. In a table of 
specifications of objectives in learning a second language, 

Rebecca M. Valette includes, for example, the following objectives which 
she considers emotional: awareness of the different aspects of language, 
tolerance regarding differences between the mother tongue and the second 
language, interest in culture, literature, the arts associated with the 
second language, desire to improve comprehension and skills in the 

second language, promotion of better comprehension of different cultural 


io 
groups. 


Clearly, then, the Government's language training programme, 
at its present stage of development, is chiefly concerned with teaching 
the essential elements of the second language and satisfying the minimal 
language requirements of bilingual positions. However, it would be 
wrong to neglect entirely the emotional objectives of this indispensable 
minimum; a negative attitude towards the second language certainly 
compromises the success of the learning procedure. It would also be 
wrong to forget that use of the second language and maintenance of the 
level of skill required in the working field perhaps depend as much on 


the attitude towards bilingualism as on capacities to communicate in the 


two languages. 


15 
See Bloom, Handbook on Formative and Summative Evaluation of Student 


Learning, chap. 22, 
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In any case, we shall one day have to give greater attention 
to the problem of the emotional objectives of a language training programme 
if our dream truly is to establish "within a reasonable period of time a 
state of affairs in which (a) an atmosphere will be created in which 
public servants of both language groups can work towards common ends, 
using their own language and drawing inspiration from their respective 
cultural values, while appreciating to their full value and respecting 


those of others" (trans.) as the Hon. L. Pearson wrote ten years ago. 


oe See Pearson, April 66. 
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2.4 CONCLUSIONS 


Analysis of the objectives of the language training programme 
of the Public Service has shown us important weaknesses which seriously 
compromise the Government's entire language policy and considerably 


diminish the credibility of the programme as a whole. 


Firstly, at the level of general objectives, we must admit 
that identification of bilingual positions took place too rapidly on the 
basis of poorly defined criteria. There has been considerable evidence 
to the effect that many positions identified as bilingual do not correspond 
to the real needs of the social environment. The bilingual training to 
be given to incumbents in these positions or applicants for the positions 
can therefore not easily be justified and the efforts put into this 
undertaking are more or less doomed to failure in advance. It will be 
impossible to make an intelligent public servant believe that he must 
master a second language to perform his daily tasks adequately if he 
knows that he, in fact, has no need of the second language to perform 
the work assigned to him. If, in spite of that reality, he is obliged 
to take a language course, he will do so unwillingly or will find cultural 
objectives other than those provided by the requirements of his position. 
This lack of realism in identifying positions probably explains to a 
great extent the very slight enthusiasm of many public servants, the 
disenchantment of many language teachers or the cynicism of more than 


one observer regarding the Government's entire language policy? 


Everything indicates that if a more solid basis is to be given 
to the entire programme, reality must be sought and a systematic verifi- 
cation of the validity of identifying positions identified as bilingual 


must be made. 


The same type of comment applies to the determination of 
levels of bilingualism and the classification of bilingual positions as 


a function of those levels. Either these differences of levels correspond 
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to real needs and become the basis of appropriate training programmes, 
or they represent only approximations, sometimes simple fictions, not to 
be taken too seriously. But then, we will have to find other means of 
distinguishing the differences between truly bilingual public servants, 
highly qualified in both languages, and the pseudo-bilinguals, scarcely 


able to get along in the second language. 


It certainly seems that here again, nothing can replace analyses 
of tasks and studies of needs which can form a solid basis for the 


Public Service's language policy. 


Regarding specific objectives, the efforts of all those who, 
on the basis of many observations, have succeeded in defining the 
language requirements of positions in easily understood terms of behaviour 
are certainly praiseworthy. On the other hand, it is sorry to see that 
language courses do not seem directly linked to the specific skills 
described in the OLAS Manual. Several historical factors may explain 
this anomaly. It is still true that if language courses must enable 
public servants to reach the language standards required for each bilingual 
position, the close links which connect the training received to specific 


objectives previously set up. 


Since the analysis of language needs of all bilingual positions 
in the Public Service represents a long and complicated task which 
cannot be completed all at one time and for which language training 
programmes under way cannot be interrupted, there might be reason to 
plan over a longer term, to proceed systematically but by successive 
stages. As a first step, for example, three levels of bilingualism 
could be distinguished, a lower level below the threashold of bilingualism, 
for positions which truly require the minimum of ability in understanding 
and speaking the second language a little; a medium level characteristic 
of all positions which require reasonable competence in the second 


language and a higher level which demands perfect mastery of all four 


eters 


basic skills. As the second step, analysis of the volume of middle- 
level positions could be pursued and priority language skills required 
for those positions could be isolated or the principal components of the 


necessary skills identified. 


As these language standards became specific, specially tailored 
learning programmes for users with different needs and more trustworthy, 


accurate instruments for measuring such progress could be devised. 


CHAPTER III 


Analysis of Evaluation Mechanisms 
and Instruments Involved 
in Language Training 
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CHAPTER 3 


ANALYSIS OF EVALUATION MECHANISMS AND INSTRUMENTS 
INVOLVED IN LANGUAGE TRAINING 


After what we have just said of the Public Service's language 
training programme objectives, the analysis of the mechanisms and 
instruments which permit evaluation of the product of the learning of 
public servants taking language courses appears to be of secondary 
importance. If the foundations of a house are found to have given way, 
there is no great enthusiasm for discovering the origin of cracks 


appearing in the walls. 


However, in spite of this reservation, it is worthwhile to 
examine how, in difficult conditions, those responsible for language 
training have set up a system of evaluating results which, up until now, 
has played a useful role; it will be easy to appreciate how much better 


they could have done in more favourable circumstances. 


By mechanisms of evaluation we mean services or groups of 
people directly involved in tasks of evaluating language competence in 
the Public Service. By instruments of measurement and evaluation, we 
mean tests of aptitude, personality, knowledge and performance, examinations, 
scales and observation grids which permit compilation of the information 
required to gauge the potential of each applicant, to evaluate his 
progress in learning the language and, when he has completed the course, 


the level of bilingualism which he has attained. 


Now, if we outline the route of a public servant student 
following a language training programme, we realize that he first appears 
before the Orientation Service of the Support Division to the Staff 
Development Branch where he will take a whole set of aptitude and placement 


tests; during his stay with the Language Bureau, he will take a whole 
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series of performance tests which will inform him how he has progressed 
in his training; when he has completed the course, he will take an 

official examination called the L.K.E. (Language Knowledge Examination). 
We can thus easily identify the four following mechanisms which is, each 


in its own way, related to the evaluation: 


- the Orientation Service, which evaluates applicants' potential; 


- the Evaluation Service of the SDB (Staff Development Branch) 


which produces tests for the Language Bureau; 


a the Language Bureau whose teachers administer the tests 


prepared by the Evaluation Service; 


= the Office of the Co-ordinator of the Official Languages 
Programme which develops and administers tests which determine 


the levels of bilingualism attained by public servants. 


The instruments used to evaluate students at different stages 
of their training may conveniently be regrouped according to the aim 


pursued in using them. We can thus distinguish: 


- the tests of the Orientation Service; 


_ the tests of the Evaluation Service (or Language Bureau) ; 


- the tests of the Office of the Co-ordinator of Official 


Languages. 


In this chapter, we shall first examine 3.1 evaluation mechanisms 
as a whole. We shall then analyze 3.2 the tests of the Orientation 
Service and 3.3 the tests of the Evaluation Service used in the Language 
Bureau. The study of the official tests of the Office of the Co-ordinator 


of Official Languages will be deferred to Chapter 4. 
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3.1 THE MECHANISMS OF EVALUATION 


We have not studied in depth the mechanisms of evaluation which 
we are about to speak. Using official documents and general information 
collected from responsible persons in the service, we simply attempted 
to locate these mechanisms within the general, highly complex organization 
of the Public Service. We then tried to understand the mandate of each 


and the contribution which it had made to evaluate language learning. 
3.1.1 The Orientation Service 


The Orientation Service is one of the many services of the 
Learning Support Division which itself constitutes an important sector 
of the Staff Development Branch of the Public Service. (See Org. 
Chart. 1) 


The mandate of this service is to discover in students the 
psycho-pedagogical factors which may favour or hinder the learning of a 
second language. Using quantitative and qualitative data compiled in 
tests and interviews, it predicts and promotes their chances of success 
by identifying the level of study which corresponds to their initial 
language competence and the learning method which seems to suit them 


best. 


The role played by the Orientation Service with the students 
and the validity of the process which it follows to guide them in their 
studies have been carefully described in a study made by three professors 
of the University of Ottawa during the month of July 1974, and in a 
report made by the director of that service presented in the month of 
December of the same year. The first document is entitled: Evaluation des 


activités professionnelles de la Division de 1'Orientation (evaluation 


of professional activities in the Orientation Division), by Messrs, S. Artaud, 
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The Orientation Service in the Organization Chart 


of the Public Service Commission 
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Commissioner Chairman Commissioner 


Staff Development 
Branch 


Learning Support 
Division 


Orientation 


Service 


Organization Chart 1 
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A. Leonoff and G. Sarrazin, and the second: Validité du processus 
d'orientation: Rapport III (Validity of the orientation process: 
Report No. III), by Mr. Winston Wells. In addition, the contribution of 
this service to the preparation of students for language courses was 


recently studied by members of research group B and explained in a 


; ; : ee ’, 
special report entitled: Student Preparation for Language Training.* 


It is therefore not necessary at the present time to review 
all the observations and criticisms which may easily be found in those 


documents. 


This earlier work relating to orientation will nevertheless 
provide us with the documents needed for concise analysis of this first 
form of student evaluation and the tests given to predict their success 


in learning the second language. 


3.1.2 The Evaluation Service 
The Evaluation Service is a unit of the Studies Division, 
another important sector of the Staff Development Branch of the Public 


Service. (See Org. Chart 2) 


The mandate of this service extends to all the important 
activities of the Staff Development Branch. In a document entitled: 
Proposition d'une politique d'évaluation a4 la Direction générale du 
perfectionnement (Proposal for an evaluation policy in the Staff 
Development Branch), of February 1975, we find two objectives of the 


service concerning the evaluation of language training which read as 


follows: 

Provide the Staff Development Branch with instruments of 
various measurement which may be useful, valid, reliable and 
objective; 

17 
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- Develop instruments of measurement appropriate to the learning 


objectives of courses and methods: 
fe) Language teaching; 
fo) Professional and managerial training courses. 


We cannot here recall the history of this service from its 
earliest days until the present, nor can we undertake an analysis of the 
many responsibilities which it carries. We shall merely note that the 
placement tests, performance tests, diagnostic tests and other instruments 
used by the Language Bureau to measure the progress of students in 
learning second languages; were set up by members of this service, who 
are at present busy divising new instruments to meet the needs of teachers 


of French as a second language. 


These, then, are the persons best placed to define the nature, 
purpose, and quality of the tests which we shall subsequently study and 


our analysis will be based primarily on the information they have provided. 


We should point out, by the way, that this evaluation service 
is concerned only with French tests intended for Anglophone students; 
English tests intended for Francophone students are prepared by another 


team, attached to Programme C of the Language Bureau. 


3.1.3 The Language Bureau 


The Language Bureau is a third division of the Staff Development 
Branch of the Public Service. Called the "Language Training Branch" 
from 1963 to 1967, then "Language School" and finally "Language Bureau", 
this institution had the task of offering language courses to public 
servants who, in performing their duties, should understand or use 


both of Canada's official languages. (See Org. Chart 3) 
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At first the Language Bureau had only a small staff, but 
during recent years there has been rapid and extraordinary growth; the 
students initially numbered 42 but there are now more than 6,000; in 
1963 there were five teachers, in 1976 there are more than 1,000. 
Activities have intensified all across Canada. Moreover, the history of 
this phenomenal development may be found in an extremely interesting 
document published on the occasion of the 10th anniversary of the 
founding of this first centre of language training in the Public Service 


in Hull, in January 1964, and entitled: Ten Years of Language Training. 


The Language Bureau obviously has the mandate to provide 
federal public servants with the language training they require. We do 
not here intend to examine its entire structure and analyze its thousand 
and one teaching activities. We wish to consider the role it plays in 


evaluating language training. 


Now, this role consists essentially in verifying the basis of 
validity in classifying students proposed by the Registrar as a function 
of the data supplied by the Orientation Service and subsequently to 
administer periodically diagnostic tests and performance tests needed to 
point out students’ weaknesses and evaluate their progress in learning 


the second language. 


The Language Bureau has no evaluation service which would be 
explicitly responsible for co-ordinating evaluation activities. The 
Bureau's executive, through their programme directors and group leaders 
assume this overall responsibility. Generally, in accordance with 
directives received, it is the language teachers who administer to 
students the tests prepared for them by the Evaluation Service of the 
Study Division and the Staff Development Branch. These tests are considered 
as teaching tools used to inform students of the result of their studies 
up until the moment when they are eligible to present themselves for the 
official examination of the Office of the Co-ordinator of the Official 


Languages Programme. 
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3.1.4 The Office of the Co-ordinator of Official Languages 


The Office of the Co-ordinator of Official Languages was set 
up two years ago, that is, at the end of 1973. At that time, no clear 
mandate had been received and the beginnings were rather shaky; no 
senior official occupied the executive position between October and 
December 1973, and the mobility of personnel in the period seriously 


compromised its initial activities. 


However, today this office is seen as the most important 
agency in the field of evaluating language training in the Public Service. 
In fact, it has been entrusted with the general responsibility of co- 
ordinating all activities and all projects likely to promote the Canadian 


Government's language policy within the Public Service. 


Two documents, dated March 1974, and entitled respectively: 
Organization of the Official Languages Program and Mandate of the Ofireral 
Languages Program describe the mandate of the Office of the Co-ordinator 


of Official Languages. 


According to these documents, the Office has the five following 


functions: 


= advising the Chairman and Commissioners of the Public Service 
on any question relating to the official languages policy and 


its application in Government Departments and agencies; 


= developing policies or participating, with the Treasury Board 
Secretariat in developing policies intended to implement the 


Government's official languages policy; 


= assuring the co-ordination of programmes and activities 
associated with the official languages policy in the Public 
Service Commission and between the Commission and the central 
agencies, the departments and other agencies, professional 


associations and the Governments of Quebec and Ontario; 
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- seeing that the Public Service Commission assumes its responsi- 


bilities in connection with: 


fe) defining language standards for positions; 

fe) administering language tests; 

fe) correcting tests; 

fo) transmitting the results of these tests; 

fe) making new tests and new evaluation techniques, including 


the organization of pilot-projects. 


= ensuring that appropriate steps are taken to measure progress 
made in the pursuit of objectives in the official languages 


assigned as responsibilities to the Public Service Commission. 
As we see it, this Office has a far-reaching mandate and 
considerable authority. For the moment, we shall retain the concept 
that the Office of the Co-ordinator of the Official Languages Programme 
has chief responsibility for: 
- defining the language standards of bilingual positions; 


- setting up language knowledge tests; 


rs administering and correcting tests to determine officially the 


level of bilingualism achieved by public servants. 
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Lastly, we shall note that the Office of the Co-ordinator 
answers directly to the Public Service Commission; whereas the Language 
Bureau, the Studies Division (which includes the Evaluation Service) and 
the Learning Support Division (including the Orientation Service and the 
Registrar) form three major units of the Staff Development Branch which 
is also ultimately answerable to the Public Service Commission. (See 


Org. Chart 4) 


Sel. Dee Reba tions existing between these evaluation mechanisms 


Obviously, all parts of this organization must be geared in 
order to operate with a degree of efficiency. A logical sequence of 
operations would be as follows: the Office of the Co-ordinator determines 
the language standards of bilingual positions; the Programme Development 
Section (Studies Division of the Staff Development Branch) prepares the 
programmes which enable public servants to achieve these objectives; the 
Evaluation Section (Studies Division of the Staff Development Branch) 
sets up instruments of measurement designed to follow the progress of 
Anglophone students towards these same objectives; at the end of the 
training period the team responsible for evaluation within Programme C 
of the Language Bureau sets up English tests for Francophones; the 
Office of the Co-ordinator, finally, checks whether public servants have 
achieved these objectives and have sufficient mastery of the second 


language to use it in their daily work. 


We see that the Office of the Co-ordinator intervenes before 
the learning takes place to fix objectives and after learning has taken 
place to ensure that they have been achieved. This is a normal situation. 
We also see that two services of the same Studies Division (of the Staff 
Development Branch), that of programme development and that of evaluation, 
work hand in hand to set up programmes for teaching French and performance 
tests administered during learning. This is also quite normal. What is 
less normal is that objectives of behaviour defined in terms of specific 


skills by the Office of the Co-ordinator do not necessarily coincide 
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with the four basic skills, more general, which have served as the 
basis for developing programmes and tests used in the Language Bureau. 
As we explained in Chapter 2, this is due to the fact that language 
courses have been given for ten years and language programmes and tests 


existed before the Office of the Co-ordinator was set up. 


Since the Office was set up at a time when training programmes 
had expanded considerably, we can easily comprehend the formidable task 
presented by co-ordination of operations as a function of more coherent 


objectives. 


One day the student learns that he must qualify for a bilingual 
position. He then presents himself at the Orientation Service (Learning 
Support Division) where he takes aptitude and placement tests. His file 
then passes to the Registrar (Learning Support) who determines the level 
of study at which he should be placed in the Language Bureau and the 
pedagogical approach which should be proposed. As he is processed, he 
will take performance tests prepared by the Evaluation Service (Studies 
Division) or by the programme team and, at a given time, the Language 
Knowledge Examination (LKE) of the Office of the Co-ordinator of Official 


Languages Programme. 


How will the student feel in the midst of this complicated 
system? Will he see the connection between the requirements of his 
position and the objectives of the course he is following? Between the 
results of the performance tests and his preparation for writing the LKE 
successfully? The evidence collected during our research by team B 
seems to indicate that he in fact feels very uncomfortable, that he is 
often badly informed when he takes preliminary orientation, that his 
file does not follow him to the Language Bureau, that in most cases, he 
never sees his orientation counsellor again. During the language courses, 
he shows a limited interest in the language tests and afterwards decides 


that they have nothing in common with the LKE test. 
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Lastly, we shall note that the Office of the Co-ordinator 
answers directly to the Public Service Commission; whereas the Language 
Bureau, the Studies Division (which includes the Evaluation Service) and 
the Learning Support Division (including the Orientation Service and the 
Registrar) form three major units of the Staff Development Branch which 
is also ultimately answerable to the Public Service Commission. (See 


Org. Chart 4) 
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Anglophone students towards these same objectives; at the end of the 
training period the team responsible for evaluation within Programme C 
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Office of the Co-ordinator, finally, checks whether public servants have 
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language to use it in their daily work. 


We see that the Office of the Co-ordinator intervenes before 
the learning takes place to fix objectives and after learning has taken 
place to ensure that they have been achieved. This is a normal situation. 
We also see that two services of the same Studies Division (of the Staff 
Development Branch), that of programme development and that of evaluation, 
work hand in hand to set up programmes for teaching French and performance 
tests administered during learning. This is also quite normal. What is 
less normal is that objectives of behaviour defined in terms of specific 


skills by the Office of the Co-ordinator do not necessarily coincide 
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with the four basic skills, more general, which have served as the 
basis for developing programmes and tests used in the Language Bureau. 
As we explained in Chapter 2, this is due to the fact that language 
courses have been given for ten years and language programmes and tests 


existed before the Office of the Co-ordinator was set up. 


Since the Office was set up at a time when training programmes 
had expanded considerably, we can easily comprehend the formidable task 
presented by co-ordination of operations as a function of more coherent 


objectives. 


One day the student learns that he must qualify for a bilingual 
position. He then presents himself at the Orientation Service (Learning 
Support Division) where he takes aptitude and placement tests. His file 
then passes to the Registrar (Learning Support) who determines the level 
of study at which he should be placed in the Language Bureau and the 
pedagogical approach which should be proposed. As he is processed, he 
will take performance tests prepared by the Evaluation Service (Studies 
Division) or by the programme team and, at a given time, the Language 
Knowledge Examination (LKE) of the Office of the Co-ordinator of Official 


Languages Programme. 


How will the student feel in the midst of this complicated 
system? Will he see the connection between the requirements of his 
position and the objectives of the course he is following? Between the 
results of the performance tests and his preparation for writing the LKE 
successfully? The evidence collected during our research by team B 
seems to indicate that he in fact feels very uncomfortable, that he is 
often badly informed when he takes preliminary orientation, that his 
file does not follow him to the Language Bureau, that in most cases, he 
never sees his orientation counsellor again. During the language courses, 
he shows a limited interest in the language tests and afterwards decides 


that they have nothing in common with the LKE test. 
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This brief analysis indicates that lack of clarity in the 
matter of objectives means similar haziness in choice of evaluation 
mechanisms and that in spite of the quality of work completed at each 


stage of language training, the results of the language training programme 


are subject to many controversies. 
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3.2 INSTRUMENTS USED FOR STUDENT ORIENTATION 


As we have seen, evaluation of students begins from the moment 
they arrive at the Orientation Service. First, there is a testing 
session, then they are interviewing individually. Although the entire 
pre-orientation procedure was analyzed in the study made by Messrs. Artaud, 
Leonoff and Sarrazin, in 1974, and the different measurement instruments 
used in this situation described in Research B, we should examine them 
briefly here to form a more accurate idea of the efforts made towards 


evaluation throughout the language training programme. 


3.2.1 The aptitude test 


The first test administered to evaluate applicants' aptitude 
for learning a second language is called the Modern Language Aptitude Test, 
the MLAT. Its devisers claim that it chiefly predicts success in 
comprehension and oral expression, but is also a reasonable indicator of 


the ability to read, write and translate a second language. 


The MLAT is an American test primarily directed to people who 
could speak English fluently; it has been used with groups of students, 
from high school to college, and with adults. This test therefore seems 
appropriate for Anglophones in the Public Service who must learn French; 
all the more so since the Orientation Service has developed its own 
standard grids and can compare the results of applicants with a population 


of federal public servants instead of with a population of Americans or 


Canadians. 


18 
See Artaud, Leonoff and Sarrazin, Evaluation des activités professionnelles 


de la Division de 1'Orientation (Evaluation of professional activities in 
the Orientation Division) 1974, and the Report on Research B. 
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The indicators of validity supplied by the authors of the 
tests and the correlations obtained by the Orientation Service between 
the results of the MLAT and the first three performance tests given in 
the Language Bureau seem to indicate that these tests give a satisfactory 
indication of aptitude for learning French and passing the first three 
performance tests, tests 707, 715 and 722 respectively, with coefficients 
OL, /3, and 68. 


The MLAT was first administered to Anglophones who were to 
sign up for French courses. As there was no equivalent form for Franco- 
phones who wanted to learn English, the Orientation Service undertook 


adaptation of the MLAT for that group of students. 


Sei elem LAS auditory discrimination test 


This test, called the Pimsleur, is intended to show the 
problems of auditory discrimination in students. Obviously, difficulty 
in distinguishing sounds clearly is a serious obstacle that must be 


recognized and evaluated in the pre-orientation course. 


When the correlations between the results of this test and the 
results of the first three performance tests are calculated, it is 
usually normal to obtain relatively low coefficients. The indicators of 
validity of this test, obtained from a sample of Anglophone students who 


had also taken tests 707, 715 and 722 are respectively .44, .35 and .49. 


Since the majority of students in the Language Bureau will 
learn the second language by using the audiolingual methods which gives 
a great importance to auditory perception and verbal expression, effective 
functioning of the auditory system plays a leading role and it is 
beneficial to give the Pimsleur test to Francophone and Anglophone 


students alike. 


3.2:3 The placement test 


The third test administered during pre-orientation is a 
language knowledge test which rates the language skills of students 
signing up for a course in the second language. The information provided 
by the results in this test obviously serve to determine the level of 


study at which the applicant should begin his language courses. 


"The aim of this type of test is to give the teacher a more 
specific idea of the store of knowledge which students have 
upon entering his class. This evaluation is necessary if the 
teaching given in each classroom is to be at each student's 
level. Thus, this test will determine the level at which each 
student should begin his French course: stage and approximate 
lessons.''19 


Placement tests, so called in English, measure, theoretically 
at least, the applicants' ability to understand spoken or written French 
or English and to express themselves in the second language, orally and 
in writing. In practice, however, it is difficult to see exactly what 
is measured except that students are placed in relation to one another 


on the basis of results obtained. 


We know they were set up by the Evaluation Service and the 
Programme C team who devised most of the tests presently in use in the 
Language Bureau and that they were probably set up using the classic 
method for setting up objective tests. But we do not have the table of 
specifications which served as basis for editing items, nor statistical 


studies to describe the principal characteristics. 


29 
See the document entitled: R6dle et importance du test de controle 
en classe (Role and importance of control tests in the classroom) 


P.S.C., Language Bureau, p. 4. 


In 1974, University of Ottawa staff described it as a knowledge 
test, the Evaluation Service as a knowledge test, the Language Bureau as 
a series of tests measuring knowledge of vocabulary and grammar, written 


and oral comprehension. 


In any event, this first sampling of students' knowledge and 
abilities includes interesting elements which, integrated into a general 
orientation service, mean that the student can be better counselled as 


he begins his language courses. 
3.2.4 The orientation interview 


The pre-orientation procedure concludes with an individual 
interview given each student by an orientation counsellor. This interview 
is not an instrument of measurement but rather a complementary technique 
for evaluating certain personal dimensions which earlier tests did not 
measure. This is also a golden opportunity to update the applicant's 
information, make him aware of his resources and handicaps with respect 
to language learning and direct him towards methods which will benefit 


him most. 


Since this aspect of orientation drew most of the attention of 
the three experts who, in 1974, evaluated the professional activities of 
the Orientation Service, we need only note that these experts felt the 


method of giving the interview was satisfactory. 


? See Ope Grte, De, a0 
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3.3 LANGUAGE BUREAU TESTS 


The tests used in the Language Bureau to evaluate the knowledge 
and language ability of students following language courses are too 
numerous to be analyzed individually. But since they have common charac- 
teristics and are all very similar, we can examine them collectively. 


We shall first make a list and then review the metrological qualities. 


3.3.1 Language tests 


Besides the placement tests which we have already mentioned, 
we may distinguish two categories of instruments which may be called 
achievement tests, control tests or diagnostic tests. To complete the 
table, we shall also mention a test conceived by a group of teachers in the 


Language Bureau as an exercise preparatory to the LKE. 


3.3.1.1 Achievement tests 


Achievement tests are examinations of an objective type which 
serve to verify the acquisition of knowledge and the development of the 
language abilities of students as they progress in their studies. Since 
they were set up as a function of the different teaching methods used in 
the Language Bureau, they may be associated with those methods and the 


content of the courses which they are meant to verify. 


Classification of achievement tests also takes into account 
the level of studies reached by the students, called lst, 2nd or 3rd 


degree. 


Five tests were prepared for those following the first part of 


the Dialogue-Canada method and apply to the first degree: 
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Test 707 (lessons 1 to 7) 

Test 715 (lessons 8 to 15) 
Test 722 (lessons 16 to 22) 
Test 730 (lessons 23 to 30) 
Test 745 (lessons 1 to 45). 


Two achievement tests at the 2nd degree were set up for the 


Ensembles pédagogiques method. These tests are called: 


Ensembles pédagogiques 1 - 10 
Ensembles pédagogiques 1 - 25 


For students using the St-Cloud method, called Voix et Images 


de France, Ist and 2nd degree tests were set up: 


ist Degree: 


No. 519: Lessons 1 to 8 (code 060 - 130) 

No. 517: Lessons 9 to 16 (code 140 - 210) 
No. 503: Lessons 17 to 24 (code 220 - 290) 
No. 504: Lessons 25 to 32 (code 330 - 370) 


2nd Degree: 


Nols SVAYS Nien iti exes IBIEIE 
No. 52607) VLE Bioc s1V 
Now 5152 VIF Code 410,630, F70. 


Three tests are associated with the Basic French method: 
No. 523: Phonetics, lessons 1 to 20. 


No. 524: Form A, lessons 1 to 45. 
No. 525: Form B, lessons 1 to 45. 


Lastly, students following the Active French method may check 


progress using tests called: 


AVE. 9: Lessons: 1. to: 9 

A.F. 18: Lessons 10 to 18 
Avie 20% “Leesone 19 to 25 
A.F. 33: Lessons 1 to 33. 


We do not have the complete list of achievement tests intended 


for Francophone students who study English. But the following taken 


from a document entitled: Second Language Testing in the Canadian Federal 


Government show that the same method is adopted for these tests. 


"The Achievement Tests are based on what the student has been 
taught and are administered throughout the training levels in 
both the French and English courses. 


One type was designed for the express purpose of placing in 
the hands of the second language teacher an administratively 
efficient and economical tool to measure, at strategic points 
(after a group of lesson units), his students' capabilities in 
the second language. As a curriculum - based measure, this 
type of test permits the teacher to determine whether or not 
the student has achieved sufficient competence in the instruc- 
tional material presented, to proceed to the next group of 
units. The teacher can also use the information supplied by 
the test results to plan and place his instruction, as well as 
to identify his students’ weaknesses and strengths. Optimally, 
the test can assist the teacher in developing a language 
competence profile for each of these students. 


The second type of achievement test was developed to be 
administered at the end of the training levels. It again 
samples the various language skills, but it is a much longer 
test and it attempts to measure the more global aspects of 
language. The results from this test assist the school 
administrators in determining whether or not a student is 


ready for the next training level and also for graduation from 
language training."21 
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See Kinrade: Second Language Testing in the Canadian Federal 
Government, p. 3. 
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3.3.1.2 Control (or diagnostic) tests 


The aim of this second series of tests is to detect students' 
strong and weak points. They still relate to well identified language 
elements. However, because of differences between the preparation of 
Anglophones learning English, the French diagnostic tests are situated 
at elementary and intermediary levels while English diagnostic tests 
have been set up at more advanced levels. This is, in fact, what emerges 


from the following passages of the document already referred to: 


"The French Diagnostic Tests concentrate on specific problem 
areas at the beginning and intermediate levels. These short, 
teacher-administered tests are scheduled when there is a need 
to diagnose comprehension, oral expression, or writing problems. 


The English Diagnostic Tests have been constructed primarily 
for the advance training level. Approximately 50% of the 
French-speaking candidates enter the training program directly 
at this stage. Hence the teacher is concerned about specific 
problems of these students who have not come up through the 
other training levels."22 


The diagnostic tests available, at the present time, for 


Anglophone users are grouped as follows: 


ist Degree: 


600 C.T.I. (060 - 100) Indirect speech, oral expression. 


600 Cert. *CL40) Indirect speech, oral expression. 
010) Geile it, Cilsvoy Avoir and @tre, oral comprehension. 
603 CettIs (080) Prepositions, oral comprehension. 
6044Gjbels (240) Pronoun '"'on'', oral expression. 

605. C. 7.26250) Imperative, oral expression. 


Ze See.Kinrade, «Op. Cites ps ds 
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2nd Degree: 

6506. Ti22(462) Imperfect, perfect, present. 

65 DAG I2eG5. Lb) Subjunctive. 

C5426 R 2 H0420) Time expressions. 

G05 1G. L292 (453) Past perfect. 

675 Conditional expressions. 

676 Relative pronouns. 

GILG sle2 | Present-imperfect of irregular verbs. 


English diagnostic tests relate particularly to tense, mood, 


the conditional, composite verb forms and pronunciation. 


3.3.1.3 Preparatory module to the LKE 


This preparatory module to the LKE 400B, conceived by a group 
of teachers of Programme A of the Language Bureau does not, strictly 
speaking, constitute a language competence test. It is rather an 
imitation of the LKE 400B test given to students before taking the 


official examination. 


Generally speaking, the instructions and sequence of taking 
the four sub-tests of the module and the number of items within each 


sub-test correspond approximately to what is found in the LKE 4OOB. 


ae522) che metrological qualities of these tests 


Even if we have no statistical data establishhing the metrological 
characteristics of the first two categories of tests 3.3.1.1 achievement 
tests and 3.3.1.2 control tests; the very fashion in which they were set 
up ensures indisputable validity of content at the outset. In fact, 
because they were prepared in conjunction with the Programme Development 
Service, that is, with those responsible for language teaching, the 


achievement tests respect the learning theories which have served as 
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bases to these methods and take into account the language objectives 
sought by these methods. The specification grids which guided the 
authors of the tests in selecting items are a clear indication that 
these tests seek to measure and allow accurate interpretation of the 
students' results. Control tests also relate to specific content which 


is easy to analyze. Their validity of content should leave nothing to 


be desired. 


It is difficult to establish how technically perfect these 
instruments are on the sole basis of the documents which we examined. 
However, it certainly seems that the uniform procedure used to make them 
satisfactory instruments of measurement conforms to the usual rules for 


construction of objective tests. 


For example, each achievement test was first given to some 
fifty students to obtain initial results and discover the major changes 


which should be made. 


Once revised, it was given to a representative sample of the 
entire student population who completed the lesson after which the test 
was to be taken. This sample included approximately 300 students in 
language schools in Ottawa and other areas, distributed in equal proportions 


at levels A, B and C. 


Following an analysis of items carried out with the results 
obtained, items retained were those with an indicator of difficulty of 
between .30 and .70 and the indicator of discrimination reached at 
least .25. Certain items with a lower indicator of difficulty (around 
.20) or a higher one (around .80) were also retained but on condition 


that the indicators of discrimination were raised. 


Items which were too easy, too difficult or which were poor 
discriminants were rejected, and a new analysis was selected to provide 
true indicators of homogeneousness and of test difficulty. Final 


results then served to establish grids of standards presented as stanines. 
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It was not thought extravagant to calculate two indicators of 
fidelity, first according to the Kuder-Richarson formula, then using 


Spearman and Brown's "Split half" technique. 


The stages in construction of these tests are accurately 
described in this passage from a document by F. Kinrade, already referred 


CO. 


"The production of a complete second language test instrument 

is an expensive undertaking. The many stages include planning 

of the instrument, collecting target language content, constructing 
items, reviewing and revising preliminary drafts, preparing 
instructions to the student, writing the script, supervising 

the art work, recording the required tapes, printing and 
proofreading of student booklets, determining the pretest 

group, pretesting, scoring and analyzing results, revising 

tests and recordings, preparing instructions to the administrator 
and markers, and preparing normative data."23 


It is truly difficult to be more demanding in constructing 
this type of test; we feel that the tests have the metrological qualities 


required of them. 


The module preparatory to the LKE 400B which we added to the 
list of Language Bureau tests has no discernible scientific value and 
probably no metrological worth either. It is simply a poor imitation of 
the LKE 400B which enables students to become accustomed to this type of 
test. We shall therefore attach no more importance to it and shall here 
retain only the conclusion of an official languages programme team 


(Testing Division) which recently analyzed that test. The conclusion 
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"Use of the module preparatory to the LKE may be continued if 
this is desired since its content does not divulge the content 
of the LKE's; it is a facsimile of the latter test and has 
exactly the same format. 


Certain similarities were obvious, but nothing significant for 
even if, in the cases indicated, structures corresponded to 
those used in the LKE's, the lexical and statistical levels 
still differed substantially. 


The module should be revised for construction is not very 
good. There were several noticeable errors in the French and 
a choice of texts which seemed odd, to say the least. There 
were also errors in the instructions given at the beginning of 
the various tests, as we have indicated. 


In short, there can be no doubt that the "Candidate's Guide" 
remains by far the best preparation for the LKE. The examples 
are better chosen, better related to the test itself, and the 
instructions piven are in accordance with requirements for LKE 
candidates.""2 


3 See the report by the research team: Comparative study of the 
Preparatory module to LKE tests and the tests themselves, p. 6 
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3.4 CONCLUSIONS 


When we consider the overall mechanisms and instruments of 
evaluation which we have just described, the most striking point is the 
lack of coherence linking one element to another and the lack of unity 


in the resulting evaluation system. 


This system is certainly not the result of logical or rational 
planning but is the product of successive improvisations produced by 
needs which must immediately be satisfied, a rapid growth of the language 
training programme and the clientele to be satisfied, urgent requirements 
for upgrading, administrative instructions to be obeyed. Language 
courses were first given in 1964, language tests set up from 1964 and 
aptitude tests given in 1973. In the meantime, it was necessary to 
recruit and train the necessary personnel, adapt or create teaching 


methods and set up orientation and evaluation services. 


That all the links in this mechanism should not be well 
oiled, that all initiative taken should not immediately be successful, 
that the need for better co-ordination should today be widely felt will 
not surprise anyone. The Office of the Co-ordinator of Official Languages 
must apply itself energetically to this effort towards co-ordination in 
order that mechanisms of evaluation may constitute a functional whole 
and the instrument's of measurement used in this system may play the 


role assigned to them and perform the services expected. 


As we have pointed out many times, the first and greatest 
weakness of the entire language training programme is concerned with 
objectives, that is, at the level of identification of bilingual positions 
and the description of language requirements; a better analysis of 
language needs, therefore, will provide the principle of co-ordination 


and language programmes and of mechanisms and instruments of evaluation 


of language competence. 


So RGus 


It is of the utmost importance that definitions of the four 
basic abilities and levels of bilingualism should have the same significance 
for those setting up language standards, for those setting up Language 
Bureau training programmes and tests, for those forecasting students' 


results and for the students themselves. At the present time, this is 


not so. 


Finally, in spite of the undeniable competence and a remarkable 
lucidity of those involved in evaluation activities, the results are 
still mediocre and give rise to considerable criticism. The orientation 
procedure is valid, the Language Bureau does its work, but the entire 
system is not very efficient because the overall policy is not really 


coherent. 
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CHAPTER 4 


ANALYSIS OF THE LANGUAGE KNOWLEDGE EXAMINATION (LKE) 


The instrument for measuring language competence which presently 
plays the most important role in evaluating bilingualism of federal 
public servants is the LKE (Language Knowledge Examination) for Francophones 
learning English. This is the test which, for all practical purposes, 
determines the level of bilingualism achieved by an individual in the 
basic skills required by an individual position or a position which he 
plans to fill. It is therefore important that it be examined carefully 
and that the qualities and faults be clearly defined. We shall attempt 
to do this by (A) describing the instrument itself; (B) analyzing it as 


a whole and in its various parts. 


Two different editions of the LKE, form 400A and form 400B 
have until the present time been used to evaluate the general language 
competence of thousands of federal public servants. At present, the 


task is to set up two equivalent forms, forms 400B and 400C. 


Since the history of the LKE 400A has become lost in the 
confusion of the beginnings of the language training programme; an 


adequate study cannot be made using only the documents now available. 


More recent and easier to trace, the 400B is better known. 
Among other things, we know this test tried to eliminate the two chief 


faults in the 400A, which were: 


= the overemphasis on the general knowledge of candidates, when 


what was to be measured was language knowledge; 


= the absence of relations existing between knowledge measured 
and the candidates abilities to perform the duties of a 


position in the second language. 
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Whilst the 400A was administered regularly from 1970 to 1974, 
the test given to Francophone public servants since December 1, 1974, was 
the 400B; this test is to be described and analyzed in the following 


pages: 
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4.1 DESCRIPTION OF THE LKE 400B 


The two versions of the 400B, the English version and the 
French version, each include four distinct parts intended to measure 
competence in a second language, aptitutde for reading, listening, 
writing and speaking. As an example, we shall here describe the French 


version intended for Anglophones learning French. 


ele: Listening Comprehension 


The part of the test relating to listening comprehension is 


itself divided into two sub-tests, of 16 to 22 items respectively. 


The items in sub-test (1) are presented in the form of questions 
accompanied by four replies which all seem possible. The questions are 
recorded on tape and the replies printed in the candidates’ notebook. 

The task of the latter is to listen to the question recorded on the 
tape, to understand the sense of the question and to indicate which of 
the four replies of which there is a choice is the correct one. One of 
the examples of this type of item, as illustrated in the candidate's 


guide to the French test 400B, reads as follows: 


Number 1: 


How were you able to complete this project alone, so quickly 
and so well? 


Answer: 

(a) by asking for help; 

(b) by skipping important stages; 
(c) by copying on another; 


(d) by working day and night. 


The 22 items of sub-test (II) are different. Each has a short 
recorded text, followed by an incomplete statement. The candidate is 


then asked to complete this statement by selecting one of four choices 
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as the optimum. Example No. 5 of the students' guide which describes 


this type of item reads as follows: 


Number 5: 


I don't know if you have found the same thing, but it always 
seems to me that every time I go into a store simply to look 

at the merchandise, I have to tell two or three different clerks 
that I don't need help. On the other hand, every time I am 
looking for something in particular, there is never a clerk to 
be seen. 


This person: 


(a) has the impression that the clerks do not want to assist 
her; 


(b) has the impression that clerks do not offer an adequate 
service; 


(c) likes to be served by two or three clerks; 


(d) does not need assistance when shopping. 


4.1.2 Reading Comprehension 


This second part of the test includes 21 passages printed in 
the candidate's exercise book. Each passage is followed by one or two 
questions, one or two beginnings of sentences. The candidate is asked 
to read each passage and answer the questions (or to complete phrases 
to make a full sentence) by choosing one of the four possibilities 
offered. Since twelve of the items are single and nine double, these 
twenty-one items may bring the candidate a total of thirty points 
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As an illustration, here is an example of a double item: 


Diane had been waiting for her husband for two hours. She 

was growing impatient because supper was getting cold and the 
dishes would not be done before ten o'clock. What excuse 
would he give for being late? At last, at about eight-thirty, 
he arrived. He was carrying a lovely bouquet of flowers which 
he must have found right across town - they were for their 


eldest daughter's twenty-first birthday. Diane could not help 
smiling. 


47. Why 


(a) 


(b) 
(c) 
(d) 
48. What 
(a) 
(b) 
(c) 
(d) 
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was Diane impatient? 


Her husband had said he would not be home that 
evening? 

Her husband loved their daughter more than her? 
Her husband had not come home? 

Her husband had no excuse? 

was Diane's reaction when she saw her husband? 
She was impatient; 

She was happy; 

She could hardly contain her delight; 

She was angry. 


4.1.3 Written expression 


This third part of the LKE has two sub-tests, the first having 


19 items and the second 11. 


Sub-test (1) includes phrases in which one word is missing. 


The candidate is asked to complete the sentence by choosing the best of 


the four words suggested. 


For examp 


le: 


1. Where are the children? Je veux ... parler. 


(I want to speak to them). 


(a) les 


(e)e Le 


(bo) ela 


(d) leur 


Sub-test (II) includes sentences where four words or groups of 


words have been underlined. Now, one of these words or groups of words 


LS aAneconrect. 


Example No. 20 
réveille. 
d 


: Au printemps quand la neige fond, la nature se 
a 


b © 


The error is found in a, b, c or d. 
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4.1.4 Oral expression 


This fourth and last part of the LKE includes three sub-tests 


of 13, 14 and 13 items respectively. 


In the first sub-test, the candidate is asked a question which 
is recorded on tape and printed in his workbook; the first part of the 
reply is also given. He is then asked to answer to the question orally, 
with a complete sentence, using the vocabulary of the question and the 
beginning of the answer as given. Thus to the question: "Will you be 
going to the office this afternoon? No ...", the candidate is supposed 


to reply: "No, I shall not be going to the office this afternoon." | 


If he replies to the question with the word: "No", his reply 


is not accepted, because he has not given a complete sentence. 


If he leaves out "No" and simply replies: "I shall not be 
going to the office this afternoon", he loses a point because he has not 


used the first part of the reply as given with the question. 


If he replies: "No, I am taking the afternoon off", his reply 


is rejected because he has not used the vocabulary in the question. 


"No, I shall not be going to the office", is also rejected 


because "this afternoon" was not included as in the question. 


Lastly, if the candidate offered: "No, I am not going to the 
office this afternoon", he would again lose a point because he used the 
present "I am not going" instead of the future "I shall not be going" as 


in the question: "Will you be going ..." 


Sub-test (II) has fourteen questions as used in general conver- 
Sation, to which the candidate must reply in complete sentences, using 
in the reply the tense of the verb used in the question. For example, 
question 14: "Until what time did you wait for the bus?" He must 


reply: "I waited for the bus until six o'clock" and not just: "Until 


six o'clock". 
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Sub-test (III) has thirteen direct exercises in verbal expres- 
Sion. The candidate is asked to construct a sentence using the given 


directions. 


For example, the candidate is told: ''Tell the secretary that 
you will be arriving late Thursday morning"; the latter must reply using 
a sentence such as: "Je serai en retard jeudi matin". (I shall be late 


Thursday morning.) 


To summarize, the LKE has four parts, 7 sub-tests and 129 


items, as may be seen in the following table: 


Sitar: Listening Comprehension. 
Sub-test Cr) 16 items 
Sub-test (II) 22 items 
Total: 38 items 
2nd) Part: Reading Comprehension. ~ 
Total: 21 items 
Sra PaLeTs Written Expression. 
Sub-test (1) 19 items 
Sub-test (II) 11 items 
Total: 30 items 
4th Part: Oral Expression. 
Sub-test (1) 13 items 
Sub-test (ITI) 14 items 
Sub-test (III) 13 items 
Total: 40 items 


TOTAL items: 129 
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4.2 ANALYSIS OF THE LKE 400B 


The content of the LKE has been the subject of much criticism 
by language teachers and students. For example, the test was found to 
contain elements which were not studied during the courses; that it does 
not measure what it should measure; that it does not reveal whether a 
candidate is truly capable of using the second language in the working 
environment. What exactly is the situation? The validity of a test and 
its other metrological qualities through a superficial examination of 
the form of items included, even if the frustration experienced by a 
great many candidates and the unfavourable comments of many teachers are 


significant negative indications. 


For this reason, the LKE must be analszed more carefully, that 
is, more thoroughly, from the point of view of: (1) its links with the 


objectives of the training programmes; (II) its chief characteristics. 


“2-2 Links wath the objectives of ‘the official languages programme 


The first point to remember is that public servants who learn 
the second language have as their objective acquisition of the knowledge 
and language skills necessary to understand the language and use it 
effectively; that is, they must achieve a certain skill in oral and 
written comprehension and a certain degree of skill in oral and written 


expression. 


Let us first agree that each of these four basic abilities may 
be mastered at four levels of excellence, called the levels of bilingualism 


O01, 02, 03 and 04, level 01 being the highest and level 04 the lowest. 


Since the LKE is given to public servants so that it may be 
discovered whether they are sufficiently bilingual to occupy a position 
identified as bilingual and to use the second language effectively in 
performing their duties, we may certainly ask whether the test permits 
that a relation be set up between the competence acquired by the public 


servant and the language requirements which are to be satisfied? Now, 


even a cursory examination of the tests which we have just described is 
enough to demonstrate that there is no obvious connection between what 
the LKE measures and public servants' objectives in learning. For 
example, let us examine the following item taken from the listening 


comprehension test: 


"In our society there are many means of finding entertainment. 
All tastes and all ages can be catered to. Everyone can 
benefit since not all forms of entertainment cost money. In 
spite of this, people often say that life is monotonous, that 
there is nothing to do, that only rich people have any fun. 

Do they say this out of laziness or lack of imagination? 


According to this text, we can say that: 


(a) Forms of entertainment are few and generally boring; 
(b) People have no time for leisure pursuits; 

(c) Leisure pursuits play a major role in our society; 
(d) You need a lot of money to have a good time. 


Remember, the candidate does not have a printed text before 
him. He has to listen, understand, remember the chief points in order 
to choose the sentence which summarizes content best. Could we say that 
whoever chooses the correct reply understands French very well? Probably, 
yes. But can we claim that anyone who does not select the correct 


answer does not understand French well? No. 


There are many ways of "understanding" French. For a public 


servant whose objective in auditory comprehension is 04, the aim is to 


"understand the essential points of a simple communication 
given at a rate slower than normal, for example, words taken 
separately or expressions of two or three words used to 
establish social contacts, say goodbye, and so on ... simple 
expressions. It is enough to understand commonly used voca- 
bulary pronounced at normal rhythms." 


We can measure the considerable gap between what is asked of 
an 04 and the skill needed to pass the above test. He will certainly 
not be successful. That being the case, why should he take a test which 


does not relate to his objectives or capabilities? 
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Similarly, items could be chosen in any sub-test, sifted 
through, related to the language requirements of positions as defined in 
the OLAS manual, to demonstrate that if the LKE seems to measure a 
certain ability to comprehend, read and speak and write the second 
language, it does not measure the specific abilities which are proposed 


as objectives to be achieved. 


Could we at least say that the LKE 400B measures the knowledge 
and ability which public servants hope to achieve during their language 
training programmme? No, this is also false. Chapter two showed us 
that development of teaching methods used in the Language Bureau preceded 
the preparation of LKE tests and there is nothing to indicate that the 
authors of the tests, when they prepared them, took into account the 


objectives of learning a language as listed by language teachers. 


The fact that students who reach a certain level of language 
competence while studying in the Language Bureau usually pass the LKE 
400B does not prove that the LKE measures the type of competence which 


teachers and students strive to acquire. 


The links between the LKE's and the language courses thus seem 
fairly tenuous and barely definable, as are the links between language 


requirements and positions. 


ee eee principal metrological characteristics of the LKE 4OOB 


However, we must study the principal characteristics of the 
LKE before making a judgement on its real value as an instrument for 
measuring competence in the second language. To achieve this we shall 
first try to analyze the intentions of persons who set it up in order to 
understand what they were trying to do and then examine the priority 
metrological criteria which it must satisfy in order to fulfill adequately 


the important role reserved for it in evaluating the language competence 


of public servants. 
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4.2.2.1 The intentions of LKE authors 


It is not easy to follow the intentions of LKE authors from 
the month of January 1971, when they were given a mandate to set up new 
examinations for testing knowledge of the second language, until the 
month of July 1974, when they presented their tests to the Public Service 


Commission. 


However, two documents enable us to conclude that they wanted 
to set up a general test of language knowledge which would make it 
possible to identify four levels of competence in each of the four basic 
abilities. The documents in question are two reports submitted to the 
Public Service Commission, entitled respectively: Presentation of the 
New LKE 400B, no date mentioned, and Final Report on the LKE 400B, dated 
July 5, 1974. 


What can be seen from these two documents is that the 400B was 
first conceived as an equivalent of the 400A, where the name 400B, and 
that the intention was subsequently to greatly improve the test. 
According to the construction plan, set up in the fall of 1971, the new 


test was to respect the following principles, among others: 


= it would provide an objective measurement of ability to 


communicate in the second language; 


- it would make it possible to establish the minimum of language 
knowledge needed to be capable of functioning at each of the 
levels of language competence recognized within the Public 


Service; 


= it would use only a general language content with common, 
ordinary words and phrases, and not a content pertaining to 


culture or specialized fields; 
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- the essential feature of measurement would relate to the basic 
syntactical components of both systems - French and English, 


as the case might be; 


- measurement would relate chiefly to the facts of the languages 
which constitute the common faults of Anglophones speaking 


French and Francophones speaking English; 


- the test would preserve the common distinction of language 
ability in listening, speaking, reading and writing, even if 
that distinction had no language basis "ut sic". (See lst 


Document, pp. 1 to 3) 


The three principal characteristics which the test should 
present were, at this stage of its development: validity, power of 


discrimination, fidelity. (See Document No. 1, p. 12) 


The validity of a test being the property of ability to 
measure what it claims to measure, the LKE should state whether such or 
such a subject meets the language standards set for positions designated 


bilingual. 


Since language standards of bilingual positions require that 
candidates be classified in four levels of competence, test 400B should 


also have the power to discriminate four overall levels of performance. 


Lastly, it should offer guarantees of fidelity, that is, 
provide stable, constant, regular, invariable results. The various 


parts of the test should also present a certain intrinsic coherence. 


The first interim report, which unfortunately is not dated, 
claims that the instrument to be developed constitutes "a good inter- 
mediary tool for measuring general performance in the second language"; 
that it discriminates among the four levels of bilingualism "better than 
the 400A"; that its indicators of fidelity, never situated above .812 in 


French and .899 in English, seem satisfactory. (See lst Document, 
pow 1355) 416) 
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However, the final report has shades of meaning, points out 
series weaknesses and even suggests what is to be done to give the 
language training programme instruments of measurement of better quality. 
For example, it is agreed that the 400B, like the 400A was prepared 
"without strict or specific relations to the real needs of positions" 
and that the "introduction of this new test will therefore not itself 
change the problem of scientific but functional evaluation of the level 


of bilingualism in federal public servants." (See 2nd Document, Summary, 
p- 1) 


Nevertheless, it was then believed that the LKE 400B repre- 
sented a test for general performance in the second language which, in 
spite of its imperfections, represented progress in relation to the LKE 


400A. (See 2nd Document, p. 38) 


4.2.2.2 Priority metrological criteria 


The authors of the LKE 400B therefore wanted to develop an 


instrument: 


= which would measure general language competence of public 


servants defined as a function of the four basic skills; 


= which would identify four distinct levels of bilingualism in 


each of the four skills; 


“3 which would predict the performance of public servants according 


to the levels of bilingualism achieved and 


- would provide relatively stable measurements of the competence 


evaluated. 


The metrological criteria which would finally determine the 


true value of the LKE tests will therefore be their capacity: 
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- to provide as pure as possible a measurement of the four 


abilities considered (validity of content) ; 


- to discriminate four levels of competence in each ability 


(power of discrimination) ; 


- to predict correctly the performance of public servants at 


each level of competence (predictive validity) ; 
- to provide stable results (fidelity). 


Let us now check whether test 400B is able to satisfy these 


four fundamental criteria. 


(a) Validity of content 


To present the problem of the validity of the content of the 
LKE 400B quite directly, we may ask: does the content of the four sub- 
tests provide an accurate measure of the four abilities in question: 
listening comprehension, reading comprehension, oral expression and 
written expression; does the content of the sub-tests measure only those 
four abilities and nothing more? In other words, does that test measure 
exactly what it claims to measure and does it provide as pure as possible 


a measurement of each ability? 


When, early in their work, the authors of the test defined the 
validity in general terms, they thought they could "measure the level of 
performance of a subject in a second language adequately" since "each 
question must be seen as a mini-performance which authorizes judging to 
a reasonable level the overall and general competence of a subject in 


his second language.'"' (See lst Document, p. 13) 


On the other hand, in their final presentation of 1974, they 
clearly distinguished the validity of the content of their test, and 


showed themselves to be more prudent. To the question: "To what extent 
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is the content of the LKE 400B a realistic miniature of every day 
functional language performance?" They replied: "The content of the 
LKE makes it possible to predict performance in the working milieu in 
the sense that each item may be considered a performance in miniature 
which permits us to estimate a wider range of similar performances. But 
this content cannot represent a realistic sample of performances which 
could be drawn from an analysis of language needs in the working environ- 


ment.'' (See 2nd Document, p. 10) 


' The validity of content of the LKE 400B is therefore subject 
to caution. However, in comparison with the 400A form, the 400B form 
offers a greater guarantee as to dimension measured, that is, there is 
greater success in neutralizing the effects of intellectual influence on 
the answers obtained. In fact, the content and form of the items of 
this test are related to the classic models used in testing for second 
languages. An effort was made to choose items which did not require 
specific verbal logic and did not have cultural overtones. High corre- 
lation (See Table 3) between the different sub-tests however show that 
there is a common factor in all four abilities measured. So far, no 
study has attempted to identify this common factor or define the exact 


and specific nature of the four abilities measured. 


In any case, the weakness in the test comes from the fact that 
the four abilities which it claims to measure were not defined at the 
outset as they had been defined by the persons responsible for identi- 


fying positions and the authors of teaching methods. 


TABLE 3 


Correlations between sub-tests 


E 400B F 400B 
LC RC LC RC 
RC .80 RC ale 
OE Oral S ' OE £82 2a 


LC: Listing Comprehension 
RC: Reading Comprehension 
OE: Oral Expression 
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(b) The power of discrimination 


We should ask, to what extent the LKE 400B is efficient in 
classifying candidates into four levels of language competence as was 


wished by its authors? This question is complex. 


In fact, by the latters' own confession, they started from the 
hypothesis that there was only one threshold of language competence and 
consequently they constructed their test only to predict a single level 
of landed performance. (See 2nd Document, p. 13). When the items in 
each sub-test were selected, the authors drew inspiration from the 
classic criteria for setting up tests of scholastic performance: 
average indicator of difficulty and high indicator of item-test discri- 
mination. These criteria ensure great internal homogeneity of the 
instrument but in no way guarantee identification of four distinct 
levels of performance. It is still possible to use the results to 
divide students into three, four or five categories and assimilate these 
categories at different levels of biligualism. But what exactly is the 


significance of levels identified in this manner? 


With another test, either more difficult or easier, levels 


requiring different interpretation would be found. 


Possibly, the authors of the 400B were over-ambitious in 
wanting to use a single instrument of general and uniform linguistic 
content to distinguish four levels of bilingualism, each clearly defined. 
If the aim was to distinguish four different levels of bilingualism, 
then the correct course would have been to select items at the four 
different levels of difficulty for each sub-test. But this would have 
increased the number of items in each test and imposed a needless burden 
on every candidate. In fact, in such cases, the easiest items would 
have had no usefulness for the most intelligent candidates and the most 


difficult would have been equally inappropriate for those with a very 


slight knowledge of French. 
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It will probably be necessary to abandon the idea of a single 
test to evaluate language competence at different levels. Specific 


tests for specific needs would probably give the best results. 


(c) Predictive validity 


It is not enough to say that the LKE is valid as an instrument 
for measuring general language competence. Since it is administered for 
a specific purpose, that is, to confirm whether an officer has a good 
enough knowledge of the second language to work in that language, it 
should be possible to predict with some degree of certainty that there 
will be language efficiency in the work environment. This is the true 


sense of predictive validity as referred -to here. 


In the document of July 1974, already mentioned, it is recognized 
on the one hand that nothing can be a substitute for the predictive 
validity of a test because the latter constitutes a crucial element of 
its overall validity; on the other hand, it is pointed out that little 
is known concerning the predictive validity of the LKE 400B in relation 
to the work environment and language standards of the positions. (See 


2nd Document, p. 12) 


However, it is considered to have good predictive validity for 
the two following reasons: firstly, during the test, it was found that 
there were always relations of more than 163 between the results of the 
test and those of free conversation as assessed by judges; secondly, 
there seems to be a positive and constant relation between the levels 
achieved by students in language courses and success in the 400B test. 


(See 2nd Document, p. 12) 


The first argument seems to carry little weight since it is 
difficult to accept a test in the form of free conversation as the only 
external criterion of a test which claims to measure ability in under- 
standing, reading, speaking and writing a second language. Statistics 
may reassure us to some extent but do not really convince us. Good 


coefficients of correlation were in fact found between the conversation 
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test and the different sub-tests of 400B; but these statistical indicators 
do not show that the four sub-tests measure four distinct abilities and 


predict good work performance in the four language skills. 


The second argument does not seem very clear to us. But it 
will always be difficult to support the claim that the 400B adequately 
predicts the language efficiency of public servants on the job because 


the most advanced students in the Language Bureau pass it regularly. 


Let us examine further the question of validation of the test 
as a function of an external criterion, the so-called free conversation 


LESt. 


"This test was intended to determine the candidate's skill in 
communicating in a second language as assessed by specialists 
in the language. During an interview, the candidates were 
asked to talk at will on general topics which interested them 
either personally or in connection with their work. A typical 
interview had been set up as a model in advance so that there 
would be some consistency in the tests. The conversation 
between the candidate and the interviewer was recorded. Using 
general but uniform criteria, three judges afterwards made an 
overall assessment. Since the judges' decisions had a high 
correlation (approximately .95) it was easy to arrive at a 
mark which might vary between 0 and 975. (See lst Document, 
p- 6) 


Having discovered that there was a close relation between the 
results of a test of oral expression and those of a test of free conversa- 


tion, the scores were divided into four levels of bilingualism called 


OL, 02; 03 and 04, 


In spite of the data processing and statistical methods used 
to give greater credibility to the standards thus established, it is 
important here to note that using cut-off points on the basis of an 
external criterion other than the true language requirements of the 
positions, there was a risk of two types of error: (a) predicting 
success and getting a failure, Type I; (Ex: deciding that X is bilingual 
at level 01 for one of the four skills when in reality he never achieves 


that level); (b) predicting a failure and obtaining a success, Type 2; 
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(Ex: deciding that X is not bilingual at level 01 for one of the four 
skills when in reality he could manage very well for the requirements of 


an Ol position in that skill). 


The first type of error may easily be observed because when a 
public servant who is supposedly bilingual does not perform efficiently, 
this is apparent; but the second type of error may not be noticed because 
public servants described as incompetent in the second language do not 
have an opportunity to prove otherwise. When the cut-off point is 
higher, there is less chance of predicting success and obtaining failure 
(Type 1) and there is more chance of predicting failure when there could 
be success (Type 2). Inversely, the lower the cut-off point, the less 
chance there is of predicting failure when there could have been success 
(Type 2), but the more risk there is of predicting success and obtaining 


failure (Type 1). 


Judging from general opinion in the Public Service the present 
level of difficulty of the LKE 400B produces more errors of Type 1 than 
of Type 2. 


Be that as it may, tests should be set up to assess the level 
of competence reached as a function of pre-determined levels of bilingualism 
and not to establish those levels in an ingenious but more or less 
arbitrary manner. That is why the true criterion of predictive validity 
of the LKE tests is the language requirements of positions, where these 


correspond to real needs. 


In short, so far, language knowledge examinations were not 
validated as a function of performance in the work environment their 
predictive validity has not been demonstrated, which is a highly regrettable 
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td) ¢ Hidelity 


Lastly, a certain fidelity is required in the LKE tests. 


Unfortunately, two different interpretations may be given to this notion 
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of fidelity. Fidelity may be seen as the coherence between the different 
parts of the test; it would then be preferable to speak of the internal 
homogeneity of the test. Fidelity may also be the stability of test 
results. For example, a test is said to reflect fidelity when it provides 
comparable results for two successive administrations, for the very simple 
reason that if it measures with a degree of accuracy the reality that 

it claims to measure, it will provide similarly realistic measures which, 


if not identical, will at least be similar. 


What is the degree of fidelity of the LKE? If we are speaking 
of the first type of fidelity, that is, the internal homogeneity of the 
test, we may say that ordinary formulae for verifying fidelity produced 
high indicators of .812 in French and .899 in English. But if we speak 
of the second type of fidelity, where there is visible stability in the 
results, we can make no certain claims. On the one hand, there has been 
no effort to determine stability of results; no mention of such an effort 
appears in any document studied. On the other hand, recent results 
obtained in the 400B when equivalent examinations 400C and 400D seem to 
reveal a certain unreliability in the results of the LKE 400B. (See 


Tables 4 and 5) 


During this work, we in fact gave the 400B test to a sample of 
177 Francophone candidates and 184 candidates from 23 Departments in 
every category of employment. Now, average indicators of difficulty 
calculated on this occasion range from 72.7 to 78.5, whereas during 
development of the test, with a similar sample, we found average indica- 
tors of difficulty ranging from .55 to .64. This evident disparity (see 


Table 5) between two series of results which should be similar deserves 


closer examination. 


See Charles Benabou, Démarche de la construction des tests équivalents 
a l'examen 400B et rapport technique de l'analyse des items (How 


tests equivalent to the 400B examination were constructed and technical 
report on analysis of items) Ottawa, October 1975, 110 p. 
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TABLE 4 


Indicators of internal homogeneity 


E 400B F 400B 
Listening comprehension I ~099 poke 
Listening comprehension II $929 Sey all 
Reading comprehension 2917, .866 
Oral expression I ---* --- 


Oral expression II =a aoe 
Oral expression III — mies 
Written expression I ; -—- — 


Written expression II --- aa 


Coefficient not reported. 


TABLE 5 


Comparison of average difficulties of items 
in two writings of the LKE 400B 


Test Version 1 Version 2 
Listening comprehension English 60.1 Viowes) 
Listening comprehension French 64.6 Tone 
Reading comprehension English 358 70 Weae Ti 


Reading comprehension French nD 410) eters 
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We did not study every facet of the LKE 400B; for example, we 
did not speak of the administrative implications of passing this test 
for thousands of Francophone and Anglophone public servants right across 
Canada; we paid no attention to the political aspect of the test which 
should "encourage people instead of discouraging them" - the latter 
being possible with a test which would become "an insuperable barrier 
for most public servants in a situation which has long prevailed and 
still prevails in many parts of the country, from an educational as well 
as a psychological, sociological and administrative point of view". 
(See lst Report, p. 5); we did not discuss similarity of standards in 
French tests for Anglophones and English tests for Francophones. We did 
not study the 400A because this test has now been withdrawn from circu- 
lation, nor did we turn our attention to the equivalent forms of the 


400C and 400D, still being developed. 


We concentrated our efforts on the LKE 400B to analyze its 
general structure and priority metrological characteristics; from our 


analysis, we were able to draw the following conclusions: 


(1) The LKE 400B test is a test of general knowledge which, as 


such, has good metrological qualities. 


In fact, in spite of the criticism we have offered in the 
preceding pages, the content of this test permits measurement of the 
four basic skills which constitute the essential core of language 
competence; it does allow grading of the respective skills of those with 
knowledge of the second language; it provides a valuable guide to the 


probable level of performance in on-the-job efficiency. 


2) Its introduction as a replacement for the LKE 400A, in 1974, 


now seems fully justified. 
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In fact, the 400B provides a more accurate measurement of 
fundamental language skills, thanks to the effort made to neutralize the 
factors related to intelligence and cultural background; it allows a 
more reliable distinction to be drawn between levels of bilingualism 
thanks to the increased number of items and efforts at validation made 


using an external criterion, the free conversation test. 


(3) However, because of its limited power of discrimination, it 
should not be used to assess extremes of language competence, that is, 


excellent or very weak. 


A test of general language skills, of average difficulty, may 
not, for example, be used to assess the competence of public servants 
who must master the second language perfectly and earn the title of 
completely bilingual. However, it is too long and too difficult for 
those from whom only a strict minimum is requested if they are to handle 
simple, stereotyped situations without needing to read or write in the 


second language. 


(4) Because of the diversity of language requirements in bilingual 
positions, this test of general knowledge should gradually be replaced 
by a set of more specific tests as improved identification of the 
language components of certain categories of positions becomes possible. 
In these tests, it should be possible to take into account both the 
language content and the basic skills needed to satisfy the exact require- 
ments of these categories of position. Instead of constructing a series 
of instruments which are totally independent of one another, it should 
be possible to set up a vast bank of items, validated as a function of 
the needs of positions and draw from this bank each time a specific test 
should be given. Such a bank of items would mean great savings in 


energy and would mean the tests had perfect confidentiality. 


(5) Because of unavoidable metrological imperfections in objective 
tests used to evaluate language competence, an effort at overall evalu- 
ation would mean utilizing the many, varied evaluations made while 


learning the second language. In fact, unless the tool used is known to 
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be perfect, all pertinent data available must be turned to account and a 


final judgment based on all measures taken along the way. 


(6) Eventually all instruments and all techniques of evaluation of 
language competence must be rethought within the perspective of a more 
rational evaluation policy, one which is more coherent and closer to 
reality and which, in the last resort, justifies the very existence of 


the language training programme. 


CHAPTER V 


Policy of Evaluating 
Language Competence 
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CHAPTER 5 
POLICY OF EVALUATING LANGUAGE COMPETENCE 


At the conclusion of this analysis of evaluation mechanisms 
and instruments, we may try to distinguish the broad outlines of the 
Public Service Commission's policy with respect to evaluating language 


learning. 


it is not easy to set out this policy in perfectly clear 
terms, for it gradually developed as the official languages programme 
grew. Its beginnings were rather shaky and the course has not really 
been set. No official public document establishes it categorically; but 
present trends may be discerned in a few confidential and semi-confidential 
documents which are particularly revealing and which we can easily 


examine. 
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5.1 PRESENT POLICY 


Let us first observe that the policy of evaluating language 
skills is closely linked to general language training policy. Now, as 
we have seen, the very bases of this training lacks solidity because of 
the discrepancy that exists between the real needs of concrete situations 
and the language requirements of positions identified as bilingual; 
between the objectives described in the directives of the OLAS manual 
and the methods of teaching languages used in the Language Bureau. It 
is therefore not surprising to discover that performance tests given 
during courses do not measure the same content and the same skills as 
those of the Office of the Co-ordinator of Official Languages. What is 
even more serious, the levels of bilingualism determined by the LKE do 
not correspond to more or less satisfactory utilization of the second 


language public servants returning to work in the Departments. 


5.1.1 Overall evaluation of the language training programme 


Up until the present time, the Canadian Government does not 
seem to have understood the importance of systematic evaluation of all 
major components of its language training programme. Now, to understand 
the programme as a whole, it is not enough to ask why some public servants 
experience such great difficulties in mastering the second language and 
why many are never successful. Primarily, the objectives of the programme 
must be re-examined to see whether they are clear and well-defined, if 
they are coherent and not contradictory; if they are realistic and based 
on the needs of positions; if they are accessible, that is, within the 
grasp of public servant, taking into account the material and psychological 
conditions in which they work. There should also be a re-examination of 
the means chosen to achieve these objectives. Cyclical courses, continuous 
courses, special courses, diverse experiments in teaching methods and 
abundant didactic material; there is also need to reflect on the possibility 
of training bilingual public servants with language courses and especially 
the profitability of a fixed learning period, at the outset, a maximum 
of twelve months. In addition, and this seems extremely important, we 


must trace the development of public servants calling themselves bilingual 
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in their work environment, evaluate the maintenance, growth or loss of 
their language competence and the actual use which they make of the 


second language in fulfilling their daily tasks. 


At present, no mechanism is provided for in the structures of 
the Treasury Board or the Public Service Commission to evaluate regularly 
and systematically and periodically update the official languages policy 
and increase the profitability of the efforts and sums invested in this 


area. 


9.1.2 Evaluation of language training 


The Government's attitude towards language training as such is 
not clearly defined. We do not know exactly how this assessment was 
attempted before 1970, that is, before the first language knowledge 
examination, the LKE/ECL 400A was given. Today, the development, administration 
and correction of the new forms of the LKE are entrusted to the Office 
of the Co-ordinator of Official Languages. Now, this agency had at 
first only a temporary mandate and many of its responsibilities were 
eventually to be entrusted to other sectors of the language training 
programme. The very name of the Office of the Co-ordinator of the 
Official Languages Programme seems in any event to suggest that the 
Office should be concerned with evaluation of the whole programme and 
not principally the administration and correction of language knowledge 


tests. 


What is still somewhat surprising is that learning as complex 
as language learning should be evaluated using a single test of general 
knowledge, without taking into account the data compiled in the Language 


Bureau using performance tests and direct observations by teachers. 


The floating of the policy regarding the evaluation of language 
learning is also translated by a distribution of responsibilities and 
the lack of co-ordination between the different levels of jurisdiction 
which control this field: Office of the Co-ordinator and Staff Development 


Branch, Studies Division, Language Bureau and Learning Support Division 
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which include the Evaluation Service, the Programme Development Service, 


the Orientation Service, the Registrar. 


For their part, officers in the language school would like to 
set up a better integrated evaluation system which would ensure greater 
validity and a certain continuity to the entire process of evaluation 
during the learning period. This system would include the following 
services grouped under the same authority: an orientation service for 
students, a placement service and a continuous evaluation service whose 
results would contribute to some extent to the determination of levels 


of bilingualism during the final evaluation. 


- 119 - 


5.2 PRESENT TRENDS 


From the texts which we have studied we may distinguish present 
trends in the Government's policy in the matter of language evaluation. 
Those responsible for the language training programme seem entirely 
aware of all the weaknesses and anomalies in the present system and if 
ever their recommendations were taken into consideration the entire 


system which we have just analyzed would be strengthened considerably. 


In this perspective, the document providing the most information 
is the Rapport final sur le ECL 400B (Final Report on the LKE 400B) 
presented July 5, 1974, and mentioned several times in the preceding 


chapter. We shall also refer to two other documents, pertaining to the 


same subject, entitled respectively: Special Study of the Public Service Commission, 


April 1974, and Rapport sur les sujets relatifs aux langues officielles 
(Report on subjects relating to the official languages), September 1974. 


The Final Report on the LKE 400B "reminds us that logic presupposes 


for testing operations as such and for language training operations an 
analysis of the concrete language needs of the various bilingual positions 
in the Public Service in order to define language standards for each 
position or each group of positions."' It is also demonstrated that 
development of the LKE 400B took place "without definite or specific 
relations with the real needs of the positions" and that "the introduction 
of this new test (in 1974) will not therefore itself change the problem 

of a scientific but functional evaluation of the levels of bilingual 


competence of federal public servants." 


The introduction of this document provides such an effective 
summary of the major problems which in the course of our study have been 
most evident, that we reproduce it as an annex at the end of the report 


(See Annex 3.) 


The second document which we wish to mention ''Special Study 
of the Public Service Commission", comes from the Office of the Commissioner 


of Official Languages. It deals with many problems relating to the 
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language training programme of the Public Service. The researchers 
responsible for this report understood that all elements of the system 
must form a whole: the language requirements of the positions, the 
language competence acquired and the tests which determine the level of 
bilingualism achieved by public servants (p. 30). They have discovered 
that no research was undertaken to verify the use of the second language 
beyond the training period or to define what is understood by functional 
bilingualism (p. 36). They also pointed out two serious anomalies in 
the process of language evaluation: firstly, we do not know whether the 
criteria which served to determine language requirements of positions 
are the same as those which served for development of the LKE tests: 
secondly, there is no relation between what is measured by the Language 


Bureau performance tests and what is measured by the LKE examinations. 


The third document, entitled ''Rapport sur les sujets relatifs 
aux langues officielles" (Report on subjects relating to the official 
languages), states the present preoccupations of persons involved in 
language evaluation. It restates the same themes and bears out the two 
precedents with respect to language standards (p. 2), language tests 


(p. 3) and learning the second language (p. 8). (See document in Annex 4) 


In short, we always return to the same fundamental problem: 
lack of coherence between the real objectives of training in the second 
language, learning activities and the instruments of measurement used to 


evaluate the results of this learning. 
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5.3 CONCLUSIONS 


The conclusions imposed at the end of this study are simple 
and clear. The bilingualism programme in the Public Service represents 
a gigantic enterprise which will cost a great deal and take time. A 
great deal of work has already been accomplished and, in spite of the 
apparent sterility of efforts made up until the present, the experience 
accumulated during the first years of trial and error may be used in 
formulating the very basis of the project and the coherence of the 


entire process of learning the second language. 


If we, in fact, wish to re-establish the credibility of language 
policy and increase the credibility of language policy, we must start at the 
beginning, consolidate the system from its base and then work through a 


system of logical and coherent thought. 


5.3.1 The objectives of language training 


If we are to set up clear and realistic objectives, we must: 


- draw up an inventory of situations where use of the 


second language seems to be justified; 


- check the basis of a bilingual label as applied to positions 


at present; 
- describe the requirements of each position specifically; 


- revise any process of identification and labelling of 


bilingual positions; 


- regroup positions in categories broad enough to avoid 
over-extension of responsibility, but homogeneous enough 


to identify the needs of specific training; 
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- gradually eliminate from lists of bilingual positions all 
those where use of the second language does not correspond 


‘to an actual need; 


- accept the provisional character of positions due to an 


evolution of work situations and language needs; 


- maintain a team to check needs and language requirements. 


5.3.2 Language training programmes 


Each time that language training objectives are specified, 


the training programmes must be revised. Consequently, it is necessary: 


“= to conceive as many language training programmes as there 
are categories of positions having the same language 


requirements; 


- to replace the only existing training programme, little 
by little, by more specific programmes corresponding to 


more clearly characterized needs; 


- to co-ordinate administrative structures and, bring 
closely together persons determining the training objectives 


and who develop teaching programmes and methods. 


5.3.3 The evaluation mechanisms and techniques 


In the same field, we must conceive the evaluation of language 
learning as a verification of objectives achieved with respect to objectives 


set up. To do this, we must: 


- set up a vast bank of items which would permit development 
of a variety of instruments of measurement related to the 
needs identified, to the objectives specified and the 


training given to highly diversified groups of students; 
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- install a system of continuous evaluation which takes 
into account all verifications carried out during the 
course as well as those which mark the end of the language 


training programme. 


Our conclusions remain fairly general because the problems 
encountered in evaluation of language learning arise from a fundamental 
difficulty met by all those working in this field: the analysis of 
language needs, the determination of learning objectives and the choice 
of criteria for evaluation. We may nevertheless affirm that this is the 
basic problem which must be attacked and that any progress in this 
direction will be translated by noticeable progress in all other aspects 
of the language training programme. (Concerning this subject, see 
Guy Plastre's report on the meeting of the ''Bureau de coordination 
linguistique internationale" (Office of International Language Co- 


ordination) dated May 1975. (See Annex 4) 
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ANNEX I 


THE DEVELOPMENT OF LANGUAGE POLICY IN CANADA 


HC May 63 


Principles 


PE April 66 


Principles 


Rights 


Duties 


Goals 


PS Phebe 67 


Goal 


House of Commons: Debates 1963, Vol. 2, 
Doe loco. 


Perfect equality of the two official languages 
in verbal and written communication with the 
public within the Departments. 


Statement by Prime Minister Lester B. Pearson, 
on the bilingualism policy in the Public 
Service, House of Commons: Debates 1966, 

Dao to=li7 


dha Equality of Francophones and Anglophones 
as applicants in the Public Service. 

2% Equality of service languages. 

Se Gradual application of principles. 


Right of the public servant to work in his 
own language. 


Right of the public servant to become 
bilingual. 


To recruit bilingual public servants to meet 
needs. To train bilingual public servants. 
Priority given to managerial and administrative 
officials. 


Public Service Employment Regulations. SOR/67 
129/54" CL) 


Language becomes a criterion in selecting 
public servants. 


TR Oet. 68 


Rights 


Statement by Prime Minister P.-E. Trudeau, 
House of Commons. 


Acceptance of the Recommendations of the 
Laurendeau Commission on language rights. 


1969 


1969 


1969 


1970 


1970 


LL July 69 


Principles 


Rights 


TB July 69 


Goals 


PS Nov. 69 


Goal 


PoeJane. 70 


Goal 


TR June 70 


Principles 


Duty 


Goals 


eidlaZ—s 


Official Languages Act. 
Equality of rights and privileges in all 
institutions of Parliament and the 


Government of Canada. 


Rights of the citizen to obtain service 
in his own language. 


Treasury Board: Bilingualism in the Public 
Service. 


des Language training for public servants. 
2 Special programmes. 


Amendments to Regulations in the Public 
Service, Sec. 4 °(@). 


Distribution of bilingual positions. 


Letters from the Public Service to 
personnel directors. 


Determination of language requirements 
of positions. 


Statement by Prime Minister Pierre-E. Trudeau, 


House of Commons: Debates 1970, p. 8487. 
(Recommendations BB IIIa). 


im Equality of Francophones and Anglophones 
in the Public Service. 
7 Report on language and "merit". 


Communications with the employee in the 
language of his choice. 


a Adaptation of language courses to the 
needs of unilingual units. 
fb Adaptation of content of courses to the 


work of public servants. 
a5 Development of receptive bilingualism. 
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LAIR DR Mar. 71 g Statement by the President of the Treasury 
Mar. 9 Board, C. M. Drury. 
Principles : iL. Equal status in both languages. 
Zs Institutional bilingualism. 
Bis French as a working language. 
Rights : dos Participatory representation in 
number and level of employment. 
Ze Right to use the language of one's 


choice in internal communications. 


Duties : ile Duty of a director to be the first to 
become bilingual. 
ve Priority for the National Capital and 
bilingual districts. 
Bis Written communications with the 
public must be published in both 


languages. 
4. To serve the public servant in his 
language. 
Goals 5 i. To have both cultures reflected in 
the Public Service. 
2 To assist public servants in acquiring 


and maintaining knowledge in the 
second language. 


3. Language needs of positions as %. 
4. To have language levels of positions 
determined by directors of services. 
L972 DR Dec. 72 p Statement by the President of the Treasury 
Dec. 4 Board, C. M. Drury, on bilingualism in the 


Public Service. 


Rights : Rights of unilinguals in bilingual positions 
with respect to statement of intention to 
learn the other language. 


Duties : To organize language training of the 
unilingual to enable him to qualify for 
bilingual positions. 


Aims : ae Four types of positions; French, 

English, convertible, bilingual. 

wae One-year priority courses for unilinguals 
occupying bilingual positions. 

oe Relation existing between language 
levels and needs of positions. 

he Identification of bilingual positions 
before December 1973. 

ay Designation of positions before 


December 1978. 


Ale he 


1974 


1964-75 
1969-75 


1975 


RP June 73 
Principle 


Rights 


Goals 


CH Nov. 74 


Rights 


Goal 


TB 64-75 


PS 69=75 


OLAS I-III 
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Resolution adopted by Parliament. June 
Language constitutes an element of merit. 


Ds Competitions for bilingual positions 
open to unilingual applicants who 
intend to become bilingual. 


fis Competitions for bilingual positions 
open to all. 
oie Options for the unilingual incumbent 


of a position which is bilingual to 
change or retain his position, or to 
become bilingual. 

De Right of seniority, the designation 
of the position notwithstanding. 


Le Identification of bilingual positions, 
unilingual and convertible. 
he Designation of these positions before 


the end of 1978. 

Sie Recruitment of unilinguals for bilingual 
positions. 

4, Language training from public funds. 


Report of the President of the Treasury 
Board, Jean Chrétien, tabled in the House 
of Commons. 


a No officer is obliged to become 
bilingual (See Options: RP June 73). 

Ze Unilingual Canadians may apply for 
any position in the Public Service. 


To provide Francophones with the means of 
working in their own language. 


Treasury Board Circulars relating to the 
official languages. 


Public Service Commission bulletins relating 
to official languages. 


The Official Languages Administrative 
Standards Manual. 3 vol. 


ANNEX 2 


Final Report on the LKE 400B presented to the 


Public Service Commission, July 5, 1974 


With respect to these bilingual positions, three additional 
responsibilities have been assigned to the Public Service Commission. 


These are: 


tags to establish the language standard required for individual 


bilingual positions; 


ue to assess the language proficiency levels of incumbents or 


appointees; 


3 to provide language training to those who do not meet the 


language requirements of the positions. 


The tone of this report may sometimes appear critical, the 
reason is that the intent is to advise the Commissioners honestly with 
regard to the current status of the program; this is seen to be particu- 
larly important in view of the high turnover of staff in the program over 
the past three years Clearly, the Office of the Co-ordinator of the 
Official Languages Program can assume neither full credit nor full 
responsibility for the outcome of decisions that were taken as long as 


three years ago. 


Ls Desirable exercise of responsibilities 


The above three responsibilities can be seen to derive from a 
common basis. The aim of these responsibilities is to ensure a functionally 
bilingual Public Service. Incumbents of bilingual positions must be 
able to discharge the duties of their positions in both French and 
English as required by the intent of the Government's bilingualism 


policy. 
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Ideally, these three responsibilities would be defined in 
terms of the functional language requirements for positions. This would 
result, first in setting language standards based on a thorough analysis 
of language needs directly related to performance on the job of specific 
subsets of positions. Secondly, by assessing whether incumbents of 
bilingual positions can satisfy the language requirements using tests 
based on the same analysis of related job types that originally provided 
the standards. Thirdly, it implies that the training curriculum of the 
Language Bureau be based on analysis of the language performance required 


by various related subsets of job requirements. 


While the above scheme, which relates these responsibilities 
(establishing language standards, assessing individuals in relation to 
those standards and training individuals so that they meet those same 
standards) to the actual language performance required in bilingual 
positions, may appear intuitively compelling, the logistics involved 
have until now prevented such a coordinated and systematic approach. 
Nevertheless, the current status with regard to these responsibilities 


is of concern here. 


De Current exercise of responsibilities 


a) Language Standards 


Presently, language standards for bilingual positions can 
require one of four general proficiency levels (01 the highest, 02, 03 
and 04) in each of four language skills (reading, listening, writing and 
speaking). In general, the standards required by a position are determined 
by position classification. For example, all Biologists in bilingual 
positions require level 02 in each of the four skills; likewise, all 
Chemists in bilingual positions require level 03 in each of the four 
Skills. However, at the request of departments, these language standards 


can be increased for given positions. 
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Standards of bilingual positions are not the main focus of 
this report; nevertheless, we must review these as they relate to the 


introduction of the LRKE 4OOB. 


= The current standards are not based on any scientific methodology. 
They refer to four general levels of language proficiency, and 
the only meaning they possess is in relation to the norms of 
the LKE. This means that if the LKE is changed, then, in fact 


the language ''standards'"' are changed. Clearly, the effect of 
introducing LKE 400B on these "standards" will depend on the 


extent it does a better job than LKE 400A. 


- The standards are not based on the actual language requirements 


of positions. This is self-evident as it is currently proposed 
that all individuals in a given classification (e.g. CR) 
required the same standard, irrespective of their actual 

duties which may vary immensely. Provision is made, however, 
for departing from these global standards if managers find the 
standards set out are either too low or too high but this is 
seen by the Official Languages Administration System as a 


procedure of exception. 


= The level of performance required does not appear to be consistent, 
in a logical sense, across employee classification; for example, 
on what basis do Biologists and Statisticians require level 02 
whereas Mathematicians and Medical Doctors only require level 03? 
Again, how is it that we require the same level of reading 


comprehension from a PE 1 and an SX 1? 
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The introduction of a new test will not per se change this 
unsatisfactory situation. Nevertheless, one highly significant difference 
between LKE 400A and LKE 400B is that it will be a more appropriate 
instrument for assessing language proficiency of public servants. More 
items per scale in this new test should permit more reliable classification. 
Thus, for example, the difference between an average level 02 speaker 
and an average level 03 speaker should be appreciable. Such a difference 
will likely prove to be relevant to job performance. This test should 
therefore, provide a better basis for staffing purposes as well as 
improve the general selection criteria for matching language proficiency 
with position requirements as they are set out now in the Official 


Languages Administration System. 


b) Language Assessment (LKE) 


Excluding the Operational Category, the LKE 400A currently 
provides the operational definition of bilingualism in the Pubic 
Service of Canada. This test has, in the past, been the subject of much 
criticism. In response to this situation, the LKE 400B was developed. 
Before implementing this new test, we should assess its merits so as to 
provide an indication of its validity. This is the next consideration 


of this paper. 


c) Language Training 


The language training curriculum currently employed is not 
based on an analysis of the language requirements of positions but on a 
general concept of what constitutes language proficiency in a second 


language. 


ANNEX 3 


Report on subjects relating to the official languages, 


dated September 23, 1974. 


SUMMARY 


The purpose of this document is to report on the responsibilities 
of the Public Service Commission relating to implementation of the 
bilingualism policy, more specifically with relation to progress and 
initiatives concerning language standards in bilingual positions, examina- 


tion of language skills, language training and maintenance. 


In addition, this report is intended to draw from the Government 
a directive on the optimum rate of success to be attained with respect 


to language courses. 


The progress made by the Public Service Commission in relation 
to questions relating to languages, combined with measures proposed by 
the standards, the examination and the maintenance of language skills 
should allow the Government to implement this policy. To summarize, it 
is recommended that the Public Service Commission should take the following 


necessary measures: 


a) to develop a system of language standards more directed towards 


employment, for bilingual positions within the Public Service; 
b) replace the LKE 400A by the LKE 400B from December 1, 1974; 
c) create new language tests based on language standards which 


relate to employment in bilingual positions in the Public 


Service; 
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d) to supply, as rapidly as possible, test instruments appropriate 
for measuring skill in the second language for levels required 
for positions where "English is essential" and positions where 


"French is essential". 


e) to examine the problem of maintaining language knowledge and 
submitting to the Treasury Board a report on means of solving 


i, 


Relatively to language courses, this report has presented an 
outline of options presently available. This should permit the Government 
to give the Commission directives on the optimum coefficient of success 


of persons following language courses. 


REPORT ON SUBJECTS RELATING TO 
FOREIGN LANGUAGES 


A. ANTECEDENTS 


iy Responsibilities of a general nature attributed to the Public 


Service, by virtue of the Public Service Employment Act include: 


a) appointment of competent persons entering the Public Service 


or already employed in it; 


b) the implementation of programmes for training and developing 


staff within the Public Service; 


c) the establishment of commissions to hear appeals on decisions 


taken with respect to these questions. 
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Dis In accordance with the parliamentary resolution of June 1973, 
the guidelines of the Treasury Board on language requirements assigned 


to the Public Service Commission or gave it continuing responsibility 


jeke yes 
a) determine the level of language skills required from applicants 
for bilingual positions and acquired by these applicants; 
b) offer language courses; 
c) to hear appeals against results of the language tests and 
language competence required in a competition; 
d) to verify levels of language skill achieved by employees in 
order to maintain standards. 
B AIM 


The aim of this document is to report on the responsibilities 
of the Public Service Commission concerning the implementation of the 
bilingualism policy, more specifically, relating to progress and initiatives 
vis-a-vis language standards of bilingual positions, examination of 


language knowledge, language training and maintenance of standards. 


In addition, this report is intended to draw from the Government 
a directive on the optimum rate of success to be achieved in language 


courses. 


A. LANGUAGE STANDARDS 


(i) The present situation 


3% Language standards of positions designated as requiring a 
certain knowledge of the second language are intended to set the level 
of knowledge as a function of specific aptitudes (speaking, reading, 


writing, understanding) which the incumbents of such positions must 


Sela = 


possess to perform their duties in a satisfactory manner. Consequently, 
such standards must set the points of reference on the basis of which 
the language competence of an individual may be tested, and they should 


set up the required programmes where language training is required. 


4. Within the framework of implementing the parliamentary resolu- 
tion of June 1973, a set of language standards was used to include all 
categories and all appropriate levels of positions within the Public 
Service, taking into account specialized requirements and regional 
situations. All positions in the Public Service for which some skill 

in the second language is required are now evaluated as a function of 


these standards. Appendix A supplies a description of the methods used. 


(ii) Implications 


as Even if the present system of language standards for positions 

has proven to be the only one applicable within the framework of implementing 
the parliamentary resolution, it will not provide satisfaction in the long 
run.’ The chief anomaly is that levels of skill in the language are 

assigned according to category and position, rather than according to the 
real requirements of the position. At least, this recourse was essential 

at the outset in order to assess with all speed some 50,000 positions but 

it relates to a state of affairs where, in a particular category and at 

such and such a level, certain positions have language standards which 

are too high for the requirements of the job, whilst other positions have 


Standards far too low. 


(iii) Activities under way 


G. The Public Service Commission is now setting up more complete 
language standards which will put the accent on the real language require- 
ments of positions in the Public Service. At present, it is estimated that 
development and application of new language standards will take about three 
years. In the meantime, the Commission will continue to revise language 
standards for specific positions, by virtue of the present system, as 


required by Departments. 


Scns 


Ws It is very important to set up language standards based on the 
requirements of the position. These standards will permit improved 
forms of language courses and more efficient performance by individuals 
and will minimize the risk of having too much or too little training, a 


risk inherent in general standards at the present time. 


8. The adoption of new language standards may also have the 
effect of modifying language tests in the sense that they must then be 
more perceptibly oriented towards the specific requirements of positions. 
We shall cope more fully with this topic in the next section which deals 


with language tests. 
(iv) Recommendation 


Se Since present language standards of bilingual positions do not 
meet long-term needs of the Public Service and in view of the importance 

of these standards in the matter of improving language tests and training 
programmes, it is recommended that the Public Service Commission be 

asked to give priority in the form of the necessary resources to developing 
a system of language standards more oriented towards employment, for 


bilingual positions in the Public Service. 
B. LANGUAGE TESTS 
(i) Antecedents 


LO; Tests for competence in the second language have become of 
crucial importance in the Public Service, since the careers and aspirations 
of public servants may be greatly influenced by the result of such 

tests. This section examines the present state of such affairs and 
formulates recommendations relating to measures to be taken in the 


future. 


ETRE = 


le At present, two tests are used to assess officers' competence 
in the second language, the Language Knowledge Examination (LKE) 400A 
and LKE 415A. The second test is given to employees in the Operational 


Category*, and the first to public servants in all other categories. 


LZ. The Language Knowledge Examination 400A was developed by the 
Public Service Commission and was given for the first time in 1970. It 
is made up of four sub-tests set up to test the competence of each 
applicant in the skills of reading, understanding the spoken language, 


writing and speaking. 


LS The Language Knowledge Examination 415A was also set up by the 
Public Service Commission and its use dates from 1971. It was originally 
made up of two sub-tests relating to aptitude in listening comprehension 
and speaking the language. Using the experience gained in application 

of this test, officers decided that the sub-test in listening comprehension 
could be eliminated and, since July 1972, employees in the operational 


category have taken tests in oral expression only. 


14. To give an idea of the scale of language tests in the Public 


Service, the following data may be reported: 


* The Operational Category includes services and trades of a general 
order, Post Office Operations, Printing Services, Hospital Services, 


Readaptation Services, Redistribution and Fire-fighting Services. 


ANNEX 4 


Extract from the Guy Plastre Report on the meeting held by the 
BILC from May IZ, to. May 16, 1975. (Pp: 3 and 4) 


Bureau of International Language Co-ordination (BILC). 


The model with which the PSC of Canada is working at present 

to try to establish language standards reflecting the language 
needs of public servants who are incumbents in bilingual 
positions was presented by Mr. Plastre and discussed by all. 

It was discovered that the general approach to bilingualism in 
the Public Service to which it pertains is in complete accordance 
with the approach called a "Training System'' (See Annex 7) used 
in the Institute of Army Education and that Lieutenant-Colonel 
Worthelhock recommends for use in the problem of military 
language training. In essence, the approach claims that to 

fix objectives of training and measurement, in language as in 
any other field in relation to the needs of an adult in 
progressing in his career or the needs of the institution 

which retains his services, the position must first be analyzed, 
the specifications listed and the objectives determined. 

During discussion of the matter, divergent views were expressed 
as to who should create tools for training and evaluation 
(intermediary stage between stages 5 and 6 of the model in 


Annex 7): course or test designers or professional trainers. 


In Cambridge, in Utrecht, in Germany, a start has been made 

on tackling the problem, preliminary to testing, of establishing 
language needs of adults as a function of their work. All 

opted for a common point of departure: the Richterich grid. 

All are working on adapting it to their own context. Even in 
NATO and SHAPE, almost nothing has been done in this area. 

The nations belonging to the alliance even seem reluctant to 
enter collectively into an operation aimed at defining an exact 


language standard for a position, associated with a standard of 


ese 


competence. Perhaps there is a wish to respect the autonomy 
of member nations. However, all deplore the lack of coherence 
and validity of language requirements believed by each and 
every country to be inherent in the procedure of assigning 


personnel in NATO and SHAPE, for example. 


A long session was also devoted to the question of the moment: 
should traditional, objective tests with multiple-choice 
answers, evaluating discrete units be replaced by more func- 
tional, more global tests, closer to communicational reality 
in 72 So long as there can be no reconciliation between the 
language criteria and the behavioural criteria of any act of 
communication, there can be no reply to that question. During 
the discussion, there was further reference to the question of 
the analysis of language needs of adults and it was concluded 
that any model for analyzing acts of communication should take 
into account personal and situational factors which are in no 
way linguistic. Will the resulting tests always be tests of 


the second or foreign language, in the strictest sense? 


This led the participants to discuss the establishment of 
validity through reference to language standards as opposed to 
those established through reference to the functional exercise 
of a global, natural task. The opinions of Spolsky (Tesol 
1968) and Clark (1974) were discussed. No agreement seemed 
possible at the time. Mr. Plastre mentioned the method used 
by the PSC to validate the LKE 400B: free conversation, and 
reported on the coefficients of conversation discovered by the 
services. The members of the various delegations found these 
data interesting but reserved judgment until there could be 


further demonstration of reliability. 
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All in all, the week was most enriching since so many professional 
contacts were made and so many ideas examined. Obviously, 
specialists everywhere have encountered the same basic problems 

in devising tests: establishment of standards related to work 
situations, definition of corresponding levels of competence. 
Problems of techniques for validating tests and of format 
(content) cannot be approached practically as long as answers _ 

to these first two questions have not been found. The docimological 
expertise to be gained by resolving these points of methodology 
(the how) will remain a matter quibbling amongst specialists for 
without attacking the real problems associated with any forms 

of evaluation, the object of the measurement process (the what), 


no progress can be made. 


Our efforts (in the O.L.P.) are thus not in vain. We are making 
headway. Or rather - we are carving a way through the jungle. 
The various national delegations want to be kept informed of 
developments and hope that we will be able to present a report 
when the next annual meeting of the IBLC is held in Canada in 
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FOREWORD 


On November 21, 1974, the Honourable Jean Chrétien, President 
of the Treasury Board, announced that the Government planned to commission 


an independent study of its language training programmes. 


In the document tabled in the House on this occasion (Report 


on implementation of the Resolution concerning the official languages 
adopted by Parliament in June, 1973, p. 8), the Minister declared: 


While techniques for teaching second languages are 
well developed, little is known- about the reasons 
why some people cannot learn. Because of the lack 
of experience in this area, a study will be carried 
out to determine why some persons appear to be 
unable to learn a second language. This study 
should contribute to a better understanding of 
learning problems and to the improvement of teaching 
methods. The results will be made available to 

the provinces and to other interested linguistic 
and educational organizations. 


On December 20, the President announced the appointment of a 
Director for the study and described the mandate that he had been 
given to recruit a team of experts to assist him in carrying out the 
study. This study would comprise, he wrote, "an examination of all 
factors related to the language training programmes of the Public 
Service" (Treasury Board, news release 74/68, December 20, 1974). 
Within the terms of the mandate entrusted to Gilles Bibeau, doctor in 
linguistics and associate professor at the Faculté des Sciences de 
1'Education of the Université de Montréal, "the study has as its 
objective to isolate from the global activity of teaching and learning 
in the Canadian Public Service those aspects which could be improved, 
corrected or adjusted to maximize the success of students who undertake 


language training". 


A research team was brought together for the planning and 
scientific supervision of the study. This team, in addition to the 


Director, includes: 


Henry P. Edwards, Ph.D. in psychology, Dean of the Faculty of 
Psychology of the University of Ottawa. 


GUESE Gis L'Institut de Formation par le Groupe, an 
organization specializing in psycho-social 
studies, represented by Yvon Rodrigue, Ph.D., 
coordinator of the Centre for Research and 
Evaluation of the IFG, and Francois Allaire, 
L.Ps. in Social Psychology. 


Raymond LeBlanc, doctor in linguistics, Director of the Centre 
for Second Language Learning and associate 
professor in the Department of Linguistics of 
the University of Ottawa. 


William F. Mackey, doctor of letters, Director - founder of the 
International Centre for Research on Bilingualism 
(CIRB), member of a number of Canadian and 
foreign governmental commissions on linguistic 
questions, professor at the University of 
Laval. 


Robert Tousignant, doctor of pedagogical sciences, Director of the 
Section for Testing and Evaluation and associate 
professor in the Faculty of Educational Sciences 
of the University of Montreal. 


Each of these persons, specializing in a different area, 
enjoys considerable prestige in his discipline. The complementarity 
of their respective interests guarantees a more balanced study than 


would be possible with greater homogeneity. 


Others working with this team include: 


Pierre Cardinal, M.A. in linguistics, research specialist at the 
Studies Division of the Staff Development 
Branch of the Public Service, as Assistant to 
the Director of the study. 


Michel Gilbert, Ph.D. in experimental psychology, professor at 
the University of Québec in Montréal, and 
senior researcher at the IFG. 


Lorraine Lebeau, L.Ps. in psychology and affiliated member of 
the Centre for Research and Evaluation of the 
IFG. 


Frances Smyth, M.A. in psychology and research officer for the 
Ottawa Separate School Board, as research 
assistant to Henry P. Edwards. 


Marjorie Wesche, Ph.D. in applied linguistics (Educational 
Theory), of the Modern Language Centre of 
O.1.S.E. (Toronto), as research assistant. 


Numerous consultations have taken place with persons involved 
in the language training programmes and with the representatives of 
Public Service bargaining agents. Intensive meetings between the 
research team and these individuals allowed the postulation of a 
number of hypotheses which might explain the present lack of satisfaction 
with results obtained by public servant-students engaged in language 
training. The nature of the information gathered and the complexity 
of the problem led the team to eliminate out-of-hand the search for a 


single or principal cause. 


In fact, it has been possible to attribute a priori the 
difficulties encountered in the teaching and learning of the second 
language to a number of factors, which interact with each other within 


the global activity of language training: 


(a) Is the general structure which the Government has set up to 
apply the Official Languages Act and the Resolution adopted 
by Parliament (June, 1973) composed of mechanisms which are 
badly co-ordinated with each other, resulting in a lack of 


coherence? 


(b) Are the linguistic objectives differently defined and under- 


stood in different areas of the programme? 


(c) Is sufficient account taken of psychological and socio- 
psychological factors which affect individuals and groups 


undergoing language training? 


(d) Are the pedagogical and other means used to attain the 


objectives sufficient and adequate? 


(e) Do the evaluation mechanisms used accurately reflect the 


results obtained in terms of the expected results? 


The research team interpreted its mandate as a request for 
specific information on these subjects, and therefore decided to orient 
its research in these directions. The administrative, psychological, 
socio-psychological, pedagogical and testing dimensions have thus been 


painstakingly examined by specialists. 


RESEARCH GROUP A 


Analysis of evaluation mechanisms and 


instruments for language training 
(W. F. Mackey and R. Tousignant) 


Research Group A was concerned with analyzing the evaluation 
mechanisms and instruments used in language training. As such an 
evaluation could only be made in terms of the objectives of the language 
training, it was first necessary to carefully examine these objectives, 
and aS a consequence to put into question the coherence of the entire 


system of language training in the Public Service. 


The system which has been established to apply the Official 
Languages Act rests on an interpretation of texts, declarations, and 
directives at different levels of the administrative structure. This 
interpretation in a sense constitutes the objectives of each level. Is 
this structure coherent? Are the objectives of each level shared by the 
lower levels? How is each organism related to the language training 
programme? Is the present organization of programmes the most economical 


possible, taking into account the objectives and the results obtained? 


We can also ask ourselves if the evaluation mechanisms preceding, 
accompanying or following language training are rigorously based on 
criteria of success which correspond to the objectives sought. Do the 


evaluation personnel charged with following the progress of students, 


ate] ae 


and officially or unofficially confirming their success or failure, work 
in close collaboration to apply a coherent and logical policy at all 
levels of the system? Do the measurement instruments used from the 
beginning to the end of training have defined statistical characteristics 
and do they provide the information needed for adequate evaluation of 


the results obtained? 


RESEARCH GROUP B 


Individual psychological factors 
(H. P. Edwards) 


One can affirm with certainty that the learning of a second 
language is not dependent only upon the manner in which it is taught, 


and the material conditions within which the teaching takes place. 


In addition to pedagogical procedures one must consider the 
general attitude of the learner, his long-term and short-term motivation 
with respect to the second language, his intellectual and linguistic 
aptitudes, his self-concept, his fundamental personality traits, etc. 

It is usually said that such factors play a more important role than 


teaching methods in the learning and maintenance of language knowledge. 


The study of these basic factors and of their relative impor- 
tance in the prediction of success in continuous language training can 
without doubt clarify our understanding of the learning of second 


languages by public servants in particular, and by adults in general. 


RESEARCH GROUP C 


Psycho-social and psycho-pedagogical factors 
(L'IFG: Y. Rodrigue, F. Allaire, L. Lebeau, M. Gilbert) 


In addition to the more strictly "individual" psychological 
variables such as aptitudes, personality, etc., there exist psycho- 


pedagogical variables in second language learning and maintenance which 


play a determining role in the language behavior of individuals who 
aspire to positions identified as bilingual. It is important to study 
these variables BEFORE, DURING and AFTER the public servant's language 
training in order to understand the conditions which encourage or 


discourage learning and maintenance of the skills learned. 


BEFORE his entrance in a language training programme the 
public servant finds himself in a work context which to a greater or 
lesser extent prepares him for learning the second language and supports 
him in this process. What are the most positive aspects of this organizational 
context? What are the most negative? Is it the support which the 
public servant receives from his superiors or his colleagues for using 
the second language at work? Is it the reinforcement in using the 
second language which he receives from those of the other language group 
with whom he converses? Is it the perceived usefulness of the second 
language for participation in the life of the Department, the Service, 


etc. ? 


DURING his stay at a Language Training Centre of the Govern- 
ment, what elements of his psycho-pedagogical context help him the most 
in the learning process? Is it the degree of cohesion which exists 
within the small group of public servants with whom he learns the second 
language for a number of months? Is it the quality of his relationships 
with the teachers from the other language group or the pedagogical 
methods which they use? Which of these factors have the greatest 
influence and what are the variables (attitudes and motivations, etc.) 
which most affect them? How does a class evolve in the course of a 


typical month? 


AFTER his return to his work milieu, does the public servant 
use the second language which he has just learned? If yes, under what 
circumstances? If no, why not? Which elements of the organizational 
context in which he finds himself contribute most to this situation? 
What effect does the use he makes of the second language have on the 


maintenance of his newly acquired knowledge? 


RESEARCH GROUP D 


Pedagogical factors 
(R. LeBlanc) 


One often has the tendency to attribute to teaching and 
everything connected with it - the teachers, the pedagogical process, 
methods, working conditions, etc. - a primary importance in an operation 
which has as its objective the learning of something. While the impor- 
tance of these factors should not be exaggerated, one cannot deny that 
without a programme, a teacher, and regular meetings between the teacher 
and the students, learning is left to the sole initiative of individuals 
and to the only means which they may have at their disposal. A competent 
professor, a proven method, an environment that favours individual 
efforts and which channels them, constitute indispensable elements for 


the rapid and structured acquisition of new knowledge. 


A research project on language education which would not 
include a careful examination of pedagogical instruments used in teaching 


would be incomplete and senseless. 


RESEARCH GROUP E 


Complementary questions 


Certain other questions, also quite important, do not relate 
specifically to general structure, psychology, or pedagogy: they are 
related at the same time to different sectors, or are situated outside 
the immediate preoccupations of teaching. Their importance has to do 
with the fact that they can have considerable influence on the language 


training programme. 


These questions concern the pre-training orientation of public 
servants; students who drop out, withdraw or return to continuous training; 


special courses in the departments; research; pedagogical techniques; 


Ea Woes 


and possibilities for use and actual use of the second language in the 
departments. We have also studied other aspects of learning: attitude 
change, theories of learning, the experimental programme of suggestopaedia, 
documents from the Commissioner of Official Languages, and finally the 
work of various international centres, in particular UNESCO and the 


Council of Europe. 


The research programme of the Independent Study has thus 
included some thirty distinct researches planned to furnish relevant 
information of a descriptive nature on most questions, and of a pre- 
dictive nature with regard to certain aspects of success in learning the 
second language. The instruments used here have been described in 


detail and justified in the reports of each research group. 


The various research studies have been entrusted in some cases 
to independent research groups composed of experts, in other cases, to 
research groups internal to the Public Service, and in still other 
cases, by contract to individual external specialists. Considerable use 
has been made of the resources of the Staff Development Branch and the 
Office of the Coordinator of the Official Languages Programme of the 
Public Service Commission, as well as those of the Official Languages 
Branch of the Treasury Board, without impeding or endangering the inde- 


pendent (external) character of the Study. 


This research report constitutes the contribution of one of 
the research groups of the Independent Study. It is part of a set of 
studies carried out by various research groups. The conclusions of this 
research, together with those of the other studies, were the principal 
sources used in the preparation of a general report, which included a 
synthesis of the situation and specific recommendations concerning areas 
which could be improved. The general report and all the other research 
reports were submitted to the President of the Treasury Board and the 


Secretary of State of the Government of Canada by April 30, 1976. 


Gilles Bibeau 
Director o£ LIP Team 
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INTRODUCTION AND OBJECTIVES 


The essential mandate of this study, within the total context 
of the "Independent Study" (PFL)*, was to identify empirically psycho- 
logical characteristics of students and teachers which may contribute 
to or detract from the process of learning French or English as a second 
language in this situation. In order to carry out this mandate, Research 
B consisted of the following phases: a review of pertinent literature, 
and interviews with selected personnel from the Language Bureau and the 
Orientation Services, to identify the psychological variables to be 
studied; identification of the populations to be studied and determina- 
tion of sampling procedures; selection of instruments for measuring the 
psychological variables to be studied; gathering of data and statistical 
analyses; and presentation and interpretation of results. Each phase 


of the research is reported as a distinct section of this report. 


Projet de recherches sur les programmes de formation linguistique. 


CHAPTER | 


Background Data 


CHAPTER I 


BACKGROUND DATA 


1.1 PUBLISHED STUDIES 


This section does not attempt to present a comprehensive 
review of literature on issues and problems related to bilingual educa- 
tion. For this, the interested reader is referred to Jakobovits (1970), 
Kelly (1969), Mackey (1974), and Overbeke (1972). Rather, its intent 
will be to review published literature which employes or suggests the 
psychological variables included in the present investigation, under the 


general headings of aptitude, attitude, and personality characteristics. 


1.1.1 General Aptitude and Second Language Learning 


Edwards and Casserly (1971), D'Arcy (1953), Johnson (1953), 
and Arsenian (1937) have reviewed studies of the possible relationships 
between measured intelligence and bilingualism. From these studies, 
although findings are by no means unanimous, the general conclusion is 
drawn that while people of widely varying degrees of intelligence are 
able to become functionally bilingual, and while general intelligence 
scores are not a major predictor of success in second language courses, 
nevertheless there is a weak but statistically significant relationship 


between intelligence scores and certain measures of bilingual competence. 


Guiford (1967), Thurstone et al. (1941, 1965), Vernon (1961) 
and other have questioned the validity of using an intelligence quotient 
as an overall measure of intelligence or general aptitude, and have 
recommended instead that intelligence be viewed as a series of relatively 
independent mental abilities. Thurstone and Thurstone, for example, : 
consider intelligence to be a series of relatively independent primary 


mental abilities, and include among the primary abilities verbal intel- 


ligence and spatial relations (Thurstone and Thurstone, 1965). Within 
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this framework, the authors of the present study have decided to include 
a measure of intelligence among the variables to be studied, and to 
employ separate indices of verbal and spatial intelligence rather than 
relying on the concept of global I.Q. This, they feel, is in keeping 
with the views of Penfield (1953), Lenneberg (1966) and others, that 
facility in learning a second language may be related to the process by 
which the left cerebral hemisphere becomes dominant for speech during 
the childhood years and the right hemisphere becomes dominant for spatial 
relationships. The writers agree with Jakobovits (1970) that the neuro- 
physiological evidence in relation to second language learning is at 
best controversial, but consider the hypothesis worthy of empirical test 
that verbal and spatial aptitudes (corresponding approximately to left 
hemisphere and right hemisphere brain functions respectively) may dif- 
ferentially predict success in the second language courses offered by 


the Language Bureau for public service personnel. 


1.1.2 Attitudes and Motivation in Relation to Second Language Learning 


Attitudes and motivation in relation to second language learn- 
ing have been thoroughly reviewed by Gardner and Lambert (1972), and 
Jakobovits (1970). There is concensus among authors in the area that 
relevant attitudes and motivation are among the major determinants of 
success in second language courses. Gardner and Lambert offer extensive 
empirical evidence of the importance of attitudes and motivation toward 
second language learning, and provide a rationale which is well summarized 


in the following quotation: 


"This theory, in brief, maintains that the successful learner 
of a second language must be psychologically prepared to adopt 
various aspects of behaviour which characterize members of 
another linguistic-cultural group. The learner's ethnocentric 
tendencies and his attitudes toward the members of the other 
group are believed to determine how successful he will be, 
relatively, in learning the new language. His motivation to 
learn is thought to be determined by his attitudes towards the 
other group in particular and toward foreign people in general, 
and by his orientation toward the learning task itself (Gardner 
and Lambert, 1972, p. 3)." 
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Based on the above rationale, the authors of the present 
study have included measures of learner attitudes and viewpoints 
towards the second language and culture. These, coupled with key 
perspectives of the learner towards the government bilingualism policy 
as it affects employment in the public service, are considered to be 
potentially important predictors of success in learning the second 


language through the courses offered by the Language Bureau. 


es Personality Variables in Relation to Second Language Learning 


Jakobovits (1970, Chapter 3) proposes that the process of 
learning is best understood in the context of learner factors, instruc- 
tion factors, and social culture factors. He suggests that strategies 
for teaching a second language must take into account both the language 
in question and the process of learning. Among the learner factors 
to be considered, aptitude, perseverance and learning strategies are 
discussed. The last two factors are considered to be affected by needs, 
habits, attitudes, and other personality characteristics which have to 
date not been adequately studied in the context of second language 
acquisition. Jakobovits, in fact, lists the Thematic Apperception 
Test and the Minnesota Multiphasic Personality Inventory as typical 
examples of measures which may be profitably employed by researchers 
attempting to assess the learner factors that affect the study of a 


second language (Jakobovits, 1970, p. 125). 


Personality variables may influence second language learning 
in a number of ways. First, as suggested above, they may influence 
the degree to which a student perseveres in language training, which 
factor would be in turn related to learning. Secondly, it is very 
important to note that certain personality variables are powerful de- 
terminants of attitudes, both due to the close interrelationships 
between attitudes and personal adjustment needs of each individual 
(Katz and Stotland, 1959; Allport, 1954) and to the fact that person- 
ality characteristics largely determine each person's degree of resist- 
ance to attitude change. Such traits as authoritarianism and per- 


suasibility have been studied in this regard (Hoffer, 1946; Adorno et 
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Gla, 19505 Janis etal; fol959)* Guiora's work showing a relationship 
between measures of empathy and authenticity of accent in the second 
language are another example (Guiora, 1971). Such studies have led the 
writers to hypothesize that fundamental personality characteristics of 
students and teachers may, together with attitudes, contribute sig- 
nificantly to student success in the courses offered by the Language 
Bureau. In fact, important clues to the improvement of language courses 
may be obtained by taking into consideration significant attitudes and 


personality characteristics of learners and of teachers. 
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1.2 BACKGROUND: PSC AND LANGUAGE BUREAU INPUTS 


This section discusses inputs received from the Public Service 
Commission and the Language Bureau, which suggested to the authors of 
Research B some of the major variables to be studied. It makes no 
attempt to review comprehensively PSC literature on language training, 
but only to outline those PSC inputs which influenced Research B's 


choice of descriptive, predictive, and dependent variables. 


1.2.1 Variables Related to the Orientation Process 


Wells (1974) studied the validity of the current process of 
orientation for language training candidates, and presented statistical 
justification for the instruments and procedures employed by the Orientation 
Services. Based on this study and on personal communications with 
personnel of the Orientation Services, the authors of Research B decided 
to employ as part of their data some of the available Orientation Services 
ratings, scores and questionnaire information, and add complementary 


measures of general aptitude and basic personality characteristics. 


The addition of general aptitude and personality characte- 
ristics was suggested not only by the review of published literature but 
by the concensus of Orientation Services and Language Bureau personnel, 
who in preliminary meetings with the PFL team expressed the viewpoint 
that the validity of predictions made at Orientation may be due not only 
to the results of the aptitude battery administered but also to the 
counsellors' insightful though informal assessments of relevant personality 


characteristics, motivation and attitudes. 


1.2.2 Inputs Related to the Study of Attitudes and Motives 


Preliminary discussions with Language Bureau personnel 
strongly suggested that although the study of teacher and student atti- 


tudes and motivation might be difficult, it should be undertaken, since 
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relevant attitudes and motivation probably affect such factors as 
rapport between teachers and students, teacher enthusiasm and effective- 
ness, student participation and efforts and the general learning at- 


mosphere. 


The view that attitudes and motivation are very important in 
the learning situation under study and deserve further attention is 
supported by the reports of several former students of the Language 
Bureau (Clark, 1975; Peters and Whitford, 1975). Clark suggests that 
motivation be added as a fourth dimension to student placement, in 
addition to second language knowledge, language aptitude, and learning 
style, with the eventual aim that candidates very high or very low on 


the motivational dimension be provided special curricula. 


Peters and Whitford conducted an attitudinal survey of Anglo- 
phone students enrolled as Asticou Language Centre during the spring of 
1975. Their study concerned itself with student perceptions of various 
aspects of the learning situation rather than with predicting success in 
language training. A review of its findings is beyond the mandate of 
the present study, except to state that they strongly suggested the need 
for including attitudinal variables in any comprehensive study of language 


training in the Public Service Commission. 


A preliminary study of language retention following completion 
of language training (Edwards, 1975) supports the view that attitudes 
and motivation deserve further study as variables related to success in 
language training. Edwards noted that some public servants appear to 
lose, rather than continue to improve upon, what they have learned 
following their return to the work setting. The second language loss is 
related to many factors, among them the perceived lack of need to use 
the second language, and the degree of willingness to use the second 


language in the working environment. 
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1.2.3 Inputs Related to the Criterion Measures 


Because the Language Knowledge Examination (LKE) is the criterion 
by which ultimate success or failure in language training is officially 
determined, the authors of Research B decided a priori to use it as the 
major criterion. They decided to use as additional criteria such variables 
as on-course teacher ratings and achievement tests scores. These would 
serve to verify the degree of correspondence among the several criterion 
measures, and also to determine which criterion measure or configuration 
of criterion measures is best predicted by the tests employed by the 


Orientation Services and by related variables used in the study. 


During preliminary discussions with personnel of the Language 
Bureau, it was apparent that many felt the LKE to be less than an optimal 
criterion in its present form. This added weight to the decision to use 
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1.2.4 Input Related to Descriptive Variables on LB Files 


During preliminary discussions with personnel at various 
levels of the Language Bureau, it was repeatedly recommended that much 
information already available in the Language Bureau files on Anglophone 
and Francophone students might be very useful to Research B, and that, 
with appropriate permission, one could use much of this information 


rather than re-obtaining it through long and redundant questionnaires. 


The authors of Research B accepted this suggestion, and com- 
bined already available information on such variables as age, appointee 


flag,* placement level, etc., with scores from their own test battery 


This variable indicates whether a language student is an incumbent 
of a designated bilingual position, a competition winner for such a 
competition from within the public service, or a competition winner 
for such a position from outside the public service. 
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administered to samples of students and teachers. This permitted a more 
comprehensive study with a minimum of inconvenience to the participating 
students. Similarly, rather than duplicating the data being gathered by 
the Studies Division of the Staff Development Branch, PSC, in a study of 
public service students and teachers of language courses taking place 

simultaneously to the Independent Study, it was decided to obtain the 

relevant data and incorporate it into the statistical analyses performed 


as part of Research B. 


25 Summary 


This section has briefly focused on PSC reports and other 
inputs which had direct bearing on the choice of variables selected as 
part of Research B. Although it is not possible in a written report to 
list all interpersonal contacts which influenced the design of the 
study, the authors wish to note in closing that the inclusion of such 
variables as on-course criterion measures and measures of attitudes and 
personality characteristics was largely in response to the many comments 


and suggestions of Language Bureau personnel. 


CHAPTER Il 


Population and Samples 
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CHAPTER II 
POPULATIONS AND SAMPLES 


The overall mandate of the Independent Study involved the 
assessment of the PSC language programmes from a broad perspective, 
ranging from a study of language training objectives to a study of the 
characteristics of candidates undergoing preliminary orientation, 
teachers and students, and public servants who have completed language 
training and returned to work. A detailed study of the teaching process 
in the Language Bureau constitutes Research D, and a study of public 
employees who have completed language training and returned to work 
forms part of Research C (See Appendices). Within this framework, it is 
within the mandate of Research B to study candidates undergoing preliminary 
orientation prior to language training, Anglophone and Francophone 
students on continuous language training courses, and characteristics of 


their teachers which are relevant to psychological aspects of learning. 


Ideally, such a study should follow a longitudinal research 
plan, assessing candidates prior to the start of their courses, follow- 
ing their on-course progress, obtaining their final criterion scores, 
and subsequently following up their progress on the job. Due to the 
contractual time constraints of the Independent Study, a cross-sectional 
approach was decided upon according to which "time samples'"* of Anglo- 
phone orientation candidates and both Anglophone and Francophone students 
and teachers on continuous language training were assessed between April 
and July, 1975. The time samples obtained consisted of all members of 
each population able to participate on a voluntary basis, as described 


in greater detail below. 


"Time samples" refers to the testing of orientation candidates, 
teachers and students on continuous language training during the 
period April-July 1975, in order to obtain representative samples 
of these populations during that time period. The test battery 
administered to any one individual required half to one and a half 
days of testing. 
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2.1 ORIENTATION CANDIDATES 


A time sample of 189 applicants for continuous language train- 
ing undergoing preliminary orientation before assignment to courses was 
selected for descriptive study. This sample represents 63% of the 
approximately 300 candidates who underwent preliminary orientation to 
French language training in the Orientation Services of the Staff De- 
velopment Branch (PSC) between April 22 and July 4, 1975. These volun- 
teers participated in a special half-day testing session, usually 


following closely their preliminary orientation interview. 


The orientation counsellors and testing personnel of the 
Orientation Services collaborated with the Research B and C teams in the 
recruitment and testing of this sample, following the guidelines and 


using the instruments provided by the research teams. 


Specifically, the collaboration of each candidate was sollicited 
by the orientation counsellors during the regular preliminary orientation 
session, by asking him or her to read the form. presented as Appendix I 
of this report. Candidates who expressed willingness to participate in 
the project were given an appointment for a half-day of testing one or 
two days later, and on that occasion were administered the battery of 
instruments described in Chapter III by a testing officer from the 
Orientation Services. The completed forms were transmitted to the 


Research B team for scoring, coding, and subsequent analysis. 


In this way, a sample of Anglophone candidates undergoing 
preliminary orientation was obtained, characteristics of which are des- 
cribed and discussed in Chapter V. It was unfortunately not possible, 
due to the very limited numbers of Francophone students entering English 
training to obtain and study a sample of Francophone candidates in 


preliminary orientation. 
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2.2 ANGLOPHONE STUDENTS ON CONTINUOUS LANGUAGE TRAINING 


The Anglophone on-course student sample consisted of 924 
students on continuous language training in the language schools of 
Ottawa and Hull who were tested during the period from May 5 to June 4, 
1975. The sample represents 55% of the approximately 1700 Anglophone 
students in continuous language courses during that period. It includes 
reasonably balanced representation from all schools and units in the 


Ottawa region. 


Since participation in the Research B and C testing was on a 
strictly voluntary basis, special efforts were made to encourage maximum 
participation. Directors of the language schools were contacted in 
advance to assure their collaboration. Several days before the scheduled 
testing sessions, members of Groups B and C visited the schools to 
discuss the proposed research, and, more specifically, the testing in- 
volved, with all students and teachers in small group meetings. At that 
time, a press release from Mr. Chrétien's office outlining the aims of 
the Independent Study was distributed to all potential participants. 
Regular classes were cancelled during the discussion and testing sessions, 
to facilitate participation. All concerned were assured that partici- 
pation would be on a strictly anonymous basis, data being coded according 
to a special system to which the key would be destroyed as soon as they 
were collated with information from Language Bureau sources for combined 


analysis in the University of Ottawa computer. 


Testing on this sample was conducted in the language schools, 
in groups ranging up to 130 students at one time. The test administra- 
tors were especially hired for the purpose, aided by teachers and coun- 
sellors whose services were provided by the language schools. Each 
subject attended two testing sessions, each lasting one-half day, usually 
arranged on two successive days. At the time of testing, each subject 
received a general information sheet (Appendix II of this report), and 
special sheets on which he or she was encouraged to make comments. A 
detailed description and discussion of this sample is found in Chapter V 


of this report. 
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The authors feel that the Anglophone on-course sample is 
representative in all important respects of the Anglophone on-course 
student population at the time of testing. A sample greater than 502 of 
the population it represents is normally considered a large sample. 
Furthermore, the authors could find no evidence of systematic bias re- 
lated to the variables under study which might have diminished parti- 
cipation on a selective basis. Rather, reasons for non-participation 
appear to have included primarily such factors as the demanding length 
of testing sessions, occasional conflicts of testing schedules with such 
pre-planned class activities as field trips, etc., previous participation 
in the standardization of achievement tests which had left certain 
classes ''test-saturated", and last but not least the fact that magnificent 
spring weather coincided with the testing dates for certain units in 
Programme A, resulting in lower participation on these sunny spring days 


than under less pleasant weather conditions. 
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2.3 FRANCOPHONE STUDENTS ON CONTINUOUS LANGUAGE TRAINING 


This sample consisted of 129 Francophone students on conti- 
nuous language training during the time period from May 5 to June 4, 
1975. This sample constitutes 62% of the approximately 200 Francophone 
students on-course during that time period. It is in effect a time 
sample selected and tested following the same procedures described above 
for the Anglophone student sample, with the exception that all preliminary 


contacts, written materials, and testing were in the French language. 


Although this sample is smaller than the Anglophone student 
sample, it represents in fact a greater proportion of the Francophone 
student population, and is judged to be reasonably representative of the 
Francophone student population on continuous training during the time 
period in question. A detailed description and discussion on this 


sample is provided in Chapter V. 


CHAPTER lil 


Tests, Questionnaires and 
Other Variables 
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CHAPTER III 


TESTS, QUESTIONNAIRES AND OTHER VARIABLES 


This section describes the tests and questionnaires admin- 
istered as part of Research B to the samples of candidates and students 
assessed, and makes reference to data from other sources included in the 


Research B analyses. 


It will be noted that somewhat different data was obtained for 
the orientation candidates, the Anglophone on-course students and the 
Francophone on-course students, based on such factors as the relative 
importance of certain variables for the three groups, availability of 
measures in the French and English languages, and the fact that orientation 
candidates, especially, were necessarily tested within severe time 
constraints. Measures obtained from other sources included instruments 
administered as an integral part of Research C, data obtained from the 
Special Study of Continuous Language Training conducted in the summer of 
1975 by the Staff Development Branch (SDB) and.data already on Orientation 
Services and Language Bureau files. Information available on Francophone 
teachers included Researches B and C test scores and SDB questionnaire 


results. 
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3.1 VARIABLES ANALYZED IN THE STUDY OF ANGLOPHONE CANDIDATES UNDERGOING 
PRELIMINARY ORIENTATION 


3.1.1 Personality Measures 


As discussed in Chapter I previous research and student and 
teacher observations indicate that personality characteristics of 
students and teachers are important in the process of second language 
learning. In this context, two personality measures were administered 


as part of Research B. They are Cattell's 16 Personality Factor Quest- 


ionnaire, Form C, and Rotter's Internal - External Locus of Control 


Questionnaire. 


a) Cattell's 16 PF, Form C, was chosen over similar instruments 
because it has been widely used in educational research on adult popu- 
lations, is specially designed for use on normal as opposed to patholo- 
gical populations, measures fundemental dimensions of the human personality 
in terms that are conceptually meaningful to lay readers, and is available 
in French and English versions. Practical considerations such as ease 
of administration in a group setting provided additional reasons for its 


use. 


The 16 PF is a 105-item self-administering questionnaire which 
takes approximately 30 minutes to complete. Each item is a question to 
be answered by choosing one of three alternatives. The test yields 20 
scores, divided into 16 first order factors and 4 second order factors. 
Scores on each factor are normally expressed on a standard scale which 
ranges from 1 to 10. The 10 point scale is bipolar, a score of 5.5 
representing the neutral point. The factors are listed below, descriptions 
on the left applying to low scores and descriptions on the right applying 


to high scores. 


Reserved, Critical - Outgoing, Warm-Hearted 
Concrete-Thinking - Abstract-Thinking 
Easily Upset, Affected by - Calm, Emotionally Stable 


Feelings 
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Conforming, Mild, Submissive 
Taciturn, Serious 

Expedient 

Shy, Timid 

Self-Reliant, Realistic 
Trusting 

Practical, Conventional 
Forthright 

Placid, Self-Assured 


Conservative, Respecting 
Established Ideas 


Group-Dependent, a "Joiner" 


Casual, Undisciplined 
Relaxed, Tranquil 

*Low Anxiety Level 
*Introverted 

*Emotionally Sensitive, Guided 
by Emotions 


*Passive, Dependent 


Assertive, Dominant, Independent 
Happy-Go-Lucky, Impulsive 
Conscientious, Persevering 
Uninhibited, Venturesome 
Dependent, Sensitive 

Suspicious 

Imaginative 

Shrewd 

Apprehensive, Worrying 


Free-Thinking, Critical, 
Liberal 


Self-Sufficient, Prefers 
Own Decisions 


Compulsive, Controlled 
Tense, Frustrated 
High Anxiety Level 


Extraverted, Socially 
Outgoing 


Decisive, Imperturbable 


Self-Directing, Independent 


More detailed information on the 16 PF and its interpretations 


may be found in the test manual (1961). 


b) Rotter's Internal - External Locus of Control Questionnaire 


was selected as a measure of an individual's sense of control over 
external events. It was intended to test the hypothesis that students 


who tend towards an internal locus of control may be capable of more 


* 
16 PF second order factors. 
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independent effort and thus greater achievement in second language 
learning than students tending towards an external locus of control, who 


may require more constant encouragement from external sources. 


The questionnaire consists of 29 2-choice questions, intended 
to elicit an answer indicative of internal or external locus of control. 


A single score is obtained on this questionnaire. 


c) In addition to the above personality measures, all samples 
studied were administered the Tennessee Self-Concept Scale as an integral 
part of Research C. The interested reader is referred to the Research C 
report. for further details. Scores from the Tennessee Self-Concept Scale 
were included in the Research B statistical analysis. Among the eight 
scores yielded by the scale, the following four are used and interpreted 


in this report: 


= Degree of Positive Total Identity 

= Degree of Positive Total Satisfaction 

- Personal Self (General Perception of the Self) 
- Social Self (Perception of Self in Society) 


3.1.2 Attitude Measures 


Preliminary discussions with personnel of the Orientation 
Service and other personnel of the Language Bureau suggested that 
attitudes toward second language learning and related topics may be 
among the most important predictors of success in the language courses 
offered by the Language Bureau. Thus, it seemed important to measure 
the relevant attitudes of candidates on orientation as well as the 


attitudes of students during their courses. 


Adaptations of scales developed by Gardner (1974), and used by 
the Language Research Group of the University of Western Ontario on 
Canadian samples, were selected for inclusion in the Research B test 
battery. Since these scales had previously been used primarily with 


high school and university populations, some questions were slightly 
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modified to adapt them for use with an adult population, while conserving 
the general import of each item. A principal components factor analysis 
of scores received by Anglophone students undergoing training replicated 
all major factors described by Gardner and his co-workers, so it was 
decided to use the scoring system of the authors for the adapted 


scales. 


The scales constitute a 65-item questionnaire, the answer to 
each item being scored on a 6 point continuum ranging from strong dis- 
agreement to strong agreement with the item. Items are grouped to yield 


the following scores: 


Ly Integrative Motivation: This scale measures an individual's 
motivation to learn the other language for reasons which are social 
in nature. This score indicates the person's desire to be like and 
to interact with members of the other language group. 


Dee Instrumental Motivation: This is a measure of the 
individual's desire to learn the second language as a means to 
a utilitarian end, as for example for reasons of career advancement. 


Oe Attitude Toward Learning the Second Language (French or 
English respectively): This is indicative of the individual's 
general positive or negative feelings towards learning the second 
language in question. 


4. Attitude Toward French or English Canadians (respectively): 
This measure, the sum of responses expressing agreement or disagreement 
with a series of positive statements about French or English 
Canadians, indicates the person's general positive or negative 
bias toward the English or French Canadian cultural group. 


Dis Interest in Foreign Languages: This is a measure of a 
person's interest in learning foreign languages in general. 


6s Encouragement from Family and Friends to learn the 
Second Language: This scale relates to the degree of support 
and encouragement offered by relatives and friends in a person's 
efforts to learn the second language. 


rie Second Language Use Anxiety: This scale indicates the 
general anxiety and feelings of tension of the respondent in his 
or her efforts to employ the second language. 
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3.1.3 Attitudinal Variables Obtained From Other Sources 


As part of Research C of the Independent Study, a questionnaire 
concerned with the second language in the context of the work environ- 
ment was developed. For details on this questionnaire, the interested 
reader is referred to the Research C report. A principal components 
factor analysis of student scores on the items constituting this 93-item 
questionnaire yielded the following factors, which were employed by the 


authors to obtain factor scores for use in Research B analyses. 


Le Degree of perceived attachment to the present office 
group. 


jie Perceived usefulness of the second language (French or 
English respectively) at work. 


Be Perceived attitudes of relevant management personnel 
towards the use of the second language at work. 


fg Perception that second language (Francophone or Anglo- 
phone) colleagues fail to demand the use of the second language or 
to appreciate efforts to use the second language. 


De Perceived need, prior to the start of language training, 
for second language (French or English) skills. 


6. Degree to which the immediate office group prefers to use 
the first language (English or French). 


fe Feelings of loss upon leaving the present office group to 
undertake language training. 


8. Degree to which the second language (French or English) 
is used outside of the work setting. 


In addition to general information provided by Orientation 
Services personnel to Research B on the preliminary counselling process, 
the Division's counsellors collaborated further by providing summaries 
on a special survey form of subjective data obtained through preliminary 
interviews with candidates preparing for language training. As with all 
other data collected, a coding system was used to maintain anonymity. 
This orientation survey provides information on the candidates' reactions 


to placement tests, previous school achievement and learning problems, 
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the interviewer's perceptions of the candidates' motivation, adaptability, 
aptitude for second language training, need for the second language and 
present knowledge of it, mastery of the first language, and the interviewers' 
overall prediction of each candidate's potential success in reaching the 


required LKE norm. 


3.1.4 Aptitude Variables Obtained From Orientation Test Files 


Language Aptitude Measures: The Orientation Services of the 


Language Bureau administers the Modern Language Aptitude Test (MLAT), 
and subtests V and VI of the Pimsleur Language Aptitude Battery (PLAB) 


to all new candidates for language training. The above measures were 
specifically developed to predict success in language training programmes, 
and their predictive and diagnostic value in the context of the PSC 
programmes has been shown previously. With approval and the permission 
of the Orientation Division, Research B utilized the five subscores of 


the MLAT and the 2 subscores of the PLAB. These scales are: 


MLAT - Number Learning 
MLAT - Phonetic Script 

MLAT - Spelling Clues 

MLAT - Words in Sentences 
MLAT - Paired Associates 
PLAB - Sound Discrimination 


PLAB - Sound-Symbol Association 


3.1.5 Employee Descriptors Obtained from Language Bureau Files 


A number of descriptors considered potentially useful in the 
statistical analyses were obtained, with permission, from the Language 
Bureau active master file, the Language Bureau test files and the 
Language Bureau assignment records. Variables obtained in this way 
included information regarding age, sex, occupational functions and 
Department, salary range, placement level, time on training, and linguistic 


and educational background. 
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3.2 VARIABLES ANALYZED IN THE STUDY OF ANGLOPHONE STUDENTS ON CONTINUOUS 
LANGUAGE TRAINING 


This section lists and describes the tests, questionnaires, 
and other variables employed in the study of Anglophone students on 
continuous language training. Measures which have been described in 
Section A will simply be listed. Other measures will be described in 


greater detail. 


3.2.1 Personality Measures 


~ Cattell's 16 Personality Factor Questionnaire, Form C 
- Rotter's Internal - External Locus of Control Questionnaire 
- Tennessee Self-Concept Scale 


3.2.2 Attitude Measures 


The Gardner - Smythe scales described in Section A were employed, 
with an additional scale which yields a score on Second Language Class 
Anxiety. This score indicates the degree to which a student feels 
anxious and tense about using the second language within the specific 


context of the classroom. 
3.2.3 Attitudinal Variables Obtained from Other Sources 


(a) Questionnaire on the Second Language in the Work Environ- 


ment (Research C). 


(b) A questionnaire on the Second Language Learning Environment 
was developed by Research C, specifically to measure 
student perceptions of the learning environment in the 
Language Bureau continuous courses. A principal components 
factor analysis yielded six major factors, which were 
used by the authors to obtain factor scores for use in 


Research B analyses. The factors are: 
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- Perceived impact of teaching methods. 


~ Perceived group cohesion and general class atmosphere. 


- General satisfaction with teachers, and with the adequacy 


of various aspects of teaching. 


= Precision of information received from the Language 


Bureau, as perceived by the student. 


- Second language skill expectations upon completion of the 


course. 


- Drive, motivation and need for achievement, channelled 


into the study of the second language. 


352g Aptitude Variables Obtained From Orientation Test Files 


The Modern Language Aptitude Test (MLAT) scores and two scores 
from the Pimsleur Language Aptitude Battery (PLAB), described in Section 3.1, 


were included in the analysis of Anglophone student data. 


Sele Employee Descriptors Obtained From Language Bureau Files 


The same descriptors were used as for Anglophone candidates 


for training. 


3.2.6 Measures of General Ability 


Although general ability as reflected by intelligence quotients 
has not been found to be a strong predictor of success in second language 
learning, it seems more likely that different aspects of intelligence 
(verbal skills, reasoning ability, spatial abilities) may differentially 


predict success in second language learning. In this context, Thrustone's 


Primary Mental Abilities Test (PMA) was chosen. 
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The PMA is a general aptitude group test which has been widely 
used throughout Canada and the United States on adult and student 
populations. It consists of a series of timed subtests which yield a 
profile of scores for the following mental abilities, considered by the 


authors to be disctinct and independent aspects of general intelligence: 


= Verbal Meaning 
= Number Facility 
= Reasoning 


= Spatial Relations 


The test is of particular interest in the prediction of second 
language learning success for several reasons. First, it has been 
suggested at times that such tests as the MLAT and the PLAB are primarily 
measures of general intelligence. If this is the case then a factor 
analysis including the PMA, the MLAT and the PLAB should yield a strong 
general ability factor. Secondly, in neurological terms, there is 
little question that language skills involve primarily the left hemis- 
phere of the brain, whereas spatial relations involve primarily the 
right hemisphere. It is possible that certain equally intelligent 
people may achieve differential success in second language learning 


depending upon whether their intelligence is primarily verbal or spatial. 


3.2.7 Variables Obtained From Other Sources 


The SDB Questionnaire Investigating Language Bureau's 


"Continuous Courses" - Learner Version for Anglophone students provided 
additional data on a large subsection of the group participating in 
Researches B and C testing sessions. Questionnaire results were made 
available for analysis with other Research B data, and provided addi- 


tional information on many aspects of continuous language training. 
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3.2.8 Criterion Measures 


It was considered beyond the practical limitations of 
Research B to administer measures of second language competence other 
than those obtainable from student files. Permission was obtained to 
use scores on the following measures from the Language Bureau Active 
Master File, the Language Bureau Test File Records, the Language Bureau 


Assignment Records, and the SDB learner questionnaire: 


- Language Knowledge Examination (LKE)* scores and norms 


attained. 
- Averaged teacher skill ratings (Ratings of student 
performance are made at the end of each six week period 


for reading, writing, listening, and speaking). 


= Averaged Language Bureau achievement test scores in 


reading, writing, listening, speaking. 


- Self-evaluation of improvement in second language skills 


while on language training (SDB questionnaire). 


* 
An appraisal of the LKE is the object of PFL Research E report. 
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3.3 VARIABLES ANALYZED IN THE STUDY OF FRANCOPHONE STUDENTS ON CONTINUOUS 
LANGUAGE TRAINING 


Every effort was made to administer to the Francophone 
students tests and questionnaires which were French equivalents of 
the tests described above for the Anglophone students. These instruments 
are listed below without further description. Instruments which are not 


equivalent to the English tests or questionnaires will be further des- 


cribed. 


3.3.1 Personality Measures 


Cattell" s: 16 Personality Factor Questionnaire 


- Tennessee Self-Concept Scale 


3.3.2 Attitude Measures 


The Gardner-Smythe Scales, (including the measure of second 


language class anxiety). 


3.3.3 Attitudinal Variables Obtained From Other Sources 


- Questionnaire on the second language in the work environ- 


ment. 


= Questionnaire on the second language learning environment. 


Soins Employee Descriptors Obtained from Language Bureau Files 


3.3.5 Measures of General Ability 


Because the Primary Mental Abilities Test has not been trans- 
lated and standardized for use with a Francophone population, and because 
a similar measure does not exist in the French language, separate tests 


of general intelligence employing verbal and non-verbal content respectively 
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were employed as measures of general ability. The verbal content test 


was the Examen Otis-Ottawa d'Habilité Mentale, forme A Supérieur. The 
non-verbal test was Cattell's Epreuve d'Intelligence Sans Apport Culturel, 


behelle LLL, forme A- 


The Otis-Ottawa is the French version of the Otis Self-Admin- 
istering Test of Mental Ability. It is an easily administered group 
test, which is primarily a measure of verbal skills and general infor- 
mation. The test is timed and consists of 75 items in ascending order 


of difficulty. It yields a global intelligence quotient. 


The French version of Cattell's Culture-Fair Test was chosen 
as a non-verbal measure of intelligence. It consists of four timed 
subtests, the content of all items being pictorial rather than verbal, 
and it provides a culture-fair global intelligence quotient. The test 
measures primarily the ability to manipulate in space, through analysis 
and synthesis, two-dimensional and three-dimensional geometrical figures. 


As such, it corresponds roughly to the spatial relations test of the PMA. 
3.3.6 Criterion Measures 


- Language Knowledge Examination (LKE) scores and norms 


attained. 
- Averaged teacher skill ratings. 


= Averaged Language Bureau achievement test scores. 
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3.4 VARIABLES ANALYZED IN THE STUDY OF FRANCOPHONE TEACHERS OF 
CONTINUOUS COURSES 


- Personality Measures: 


Cattell's 16 Personality Factor Questionnaire, Form C 


- Attitude Measures: 


The Gardner-Smythe scales 


- Variables Obtained from Other Sources: 


The SDB Questionnaire d'Enquéte sur les cours continus 
au Bureau des langues - version du professeur provided 


descriptive data on a large subsection of the Research B 


sample of Francophone teachers. 


This concludes the description of variables employed by 
Research B. In addition to the above, the comments of 
candidates undergoing preliminary orientation, students 
on continuous language training, and teachers, were 
sought and encouraged, for qualitative and quantitative 


analysis. 


CHAPTER IV 


Statistical Analysis 
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CHAPTER IV 
STATISTICAL ANALYSIS 


The quantitative objectives of Research B involved the 
statistical description of each sample studied, a study of variables 
which might contribute to the prediction of success in language training 
for Anglophone and Francophone students respectively, and a study of 
potentially important relationships among pre-selected variables. It 
was decided a priori that in order to maintain the necessary confident- 
iality, all data for each subject studied would be collated, coded with 
a special Independent Study number and analyzed in the computer of the 


University of Ottawa. 


Since it was intended that data collected as part of the Re- 
searches B and C testing sessions would constitute only part of the data 
to be analysed statistically, other data being obtained as appropriate 
from Language Bureau files, the Orientation Services, and the Studies 
Division of the SDB, a consulting firm* was subcontracted to prepare 
on tape a master file, systematically bringing together the data 
obtained from all sources. On the master file thus prepared, all 
information for each participating subject was recorded, and identified 
according to the special code. Social insurance numbers provided by 
the participating subjects were employed in the creation of the master 
file, but were not recorded on it. The completed and corrected master 
file became available for statistical analysis in December 1975. Such 
factors as missing data, redundant but differently coded information on 
the Language Bureau files, the fact that LKE results of candidates taking 
the Researches B and C tests in May and June would only be available weeks 
or months later in sufficient numbers, and delays in the scoring of 
personality and other standardized tests all combined to make the 
completion of the master file a time-consuming process. For this 
reason, given the stringent deadlines for the presentation of the 


final report of the Independent Study, only key statistical analyses 


Hopwood, Dunlop and Associates, Ottawa. 
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were performed on the available data. The authors recommend that 
further analyses of the coded data available on the master file for 
orientation candidates, students and teachers be undertaken by Treasury 
Board, or that the data be made available to researchers in the field 


of language learning. 


For purposes of description, variables were divided into those 
representing discrete and continuous data. Discrete variables were 
analyzed in terms of frequency distributions, percentages, and cumulative 
percentages. Statistics obtained for continuous variables include means, 


medians, modes, standard deviations, and indices of skewness and kurtosis. 


As a preliminary to the study of variables which might 
contribute to the prediction of success in language training, it was 
felt that the excessively large number of variables on the master file 
should be simplified through the use of factor analysis, and that factor 
analysis of the scales constructed by the Research C team would further 
help this reductionistic aim. It was also decided to replicate the factor 
analysis of the Gardner-Smythe attitude scales, although these had been 
previously factor analyzed by their authors, in order to ascertain that 
the major factors described by the authors would replicate on the Public 
Service population. In all cases, the technique of factor analysis chosen 
was principal components factor analysis without iterations, with eigenvalues 
set at 1.5, varimax rotation, and when appropriate, with the instruction 
to yield factor scores. This procedure is a currently used technique of 
factor analysis, which is in fact a direct transformation of the raw data, 
requiring no major a priori assumptions. The interpretation and naming 
of factors derived from each factor analysis was based on observation 
of the varimax rotated factor matrix, and study of the variables which 


had factor loadings greater than 0.40 with reference to each of the factors 


identified. 


Stepwise multiple regression analysis was used in the study 
of variables or factors which might contribute to the prediction of 


success in language training. Since the number of potential predictors 


OR 


in the master file was in all cases too large, it was decided to employ 
as predictor variables only variables which significantly loaded on the 
relevant factors identified from the preliminary factor analyses. In 
addition, since interpretable factor scores were obtained during the 
preliminary factor analyses, separate regression analyses were done 


using as predictors individual variables and factor scores respectively. 


The further study of selected relationships among pre-determined 
variables made use of Pearson correlation matrices, and selected comparisons 
or pre-determined groups were made using one-factor, univariate analyses 


of variance. 


Time constraints made it mandatory to use an available statis- 
tical package, and it was thus decided to perform all calculations using 
the current version of the Statistical Package for the Social Sciences 
(SPSS). For further details on the statistical analyses*, the reader is 


referred to the SPSS Manual (1975). 


As a final note on the statistical treatment of data, the 
problem of missing values in any individual file always poses a dilemma. 
It was decided, somewhat arbitrarily, that the median score would be 
substituted for missing values in factor analyses and regression analyses 
in order to prevent losing complete sets of variables on the basis of a 


few missing values. Pairwise deletion was used in correlation analyses. 


The analyses were executed by the University of Ottawa's Department of 
Computer Applications. 
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CHAPTER V 


Results and Conclusions 
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CHAPTER V 
RESULTS AND CONCLUSIONS*# 


This chapter presents and discusses the results of Research B. 


It is divided into two major sections. 


Section A is an analysis of written comments on bilingualism 
policy and the language training programme by students and teachers who 


took part in the Research B and C testing sessions. 


Section B presents the results and conclusions which are based 
primarily on quantitative analysis of data. Separate sub-sections 
discuss the criterion variables and the results and conclusions based on 


the study of each sample listed in Chapter II of this report. 


The taped computer data and other documents on which these conclusions 
are based are stored at the University of Ottawa. Contact Dr. Edwards, 
Faculty of Psychology, for further information. 
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5.1 REPORT ON COMMENTS OF LANGUAGE SCHOOL STUDENTS AND TEACHERS ON 
BILINGUALISM AND THE LANGUAGE TRAINING PROGRAMME 


During the months of May and June, 1975, students and teachers 
of the Language Bureau schools in Ottawa-Hull and Montreal participated 
in a testing session for the PFL. In all, 924 Anglophone students, 129 


Francophone students and 290 Francophone teachers took part. 


In addition to the tests, students and teachers were encouraged 
to express their opinions on the government's bilingualism policy and on 
the second language learning experience by submitting written comments. 

A prepared comment sheet was distributed, the English version of which 
stated: "If you have any comments to make with respect to the language 
training programme, bilingualism policy and implementation, or this 
research, we would appreciate your writing them here. You may be 

assured that they will be carefully considered by the research team." 

474 students, approximately half of both the Anglophone and the Francophone 
samples, as well as 121 or approximately 422% of the Francophone teachers, 


submitted comments. 


These comments were read and analyzed in an attempt to bring 
to light the issues and problems which concern civil servants on language 


training and their teachers. 


The analysis for each group subdivides comments into two broad 
areas - Bilingualism, and the Language Training Programme. Each of 
these topics if further divided into subsections. 87% of the Franco- 
phone student comments had to do with the Language Training Programme 
and only 13% with Bilingualism, whereas in the Anglophone sample, 66% of 
the comments were on the Language Training Programme and 34% on Bilingualism. 
Francophone teachers were again more concerned with the training programme, 


75% of their comments being on this topic, while 25% of the comments had 


to do with Bilingualism. 
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Comments from the Francophone student sample were somewhat 
more favourable overall than those of Anglophone students, with 35% of 
Francophone comments either positive or mixed, whereas in the Anglophone 
student sample 80% of the comments were negative. Francophone teachers 


were also quite negative, with over 80% of their comments in this category. 


This section presents a summary of the ideas inherent in the 


comments, discussing each of the three groups in turn. 


5.1.1 Comments of Anglophone Students 


5.1.1.1 Bilingualism 


The government bilingualism policy and its implementation was 


one of the key issues which concerned Anglophone students. 


Generally speaking, students seemed to be in favour of bi- 
lingualism in the public service; however, many felt that the implemen- 


tation of this policy leaves much to be desired. 


It appeared to be a near unanimous opinion that an excessive 
amount of money is being spent in order to bilingualize the public 
service, and that the money could be better spent in aiding French 
language education in primary and secondary schools. In brief, the 
feasibility of training monolingual adults to become bilingual was 


seriously questioned. 


A large percentage of students also felt that some measures 
must be taken to ensure the use of French in the work environment after 
language training. They stated that in many cases, they would not be 
using French in the work milieu, and consequently would lose what French 


they had acquired as a result of language training. Positive suggestions 
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as to how to ensure the use of French on the job included such possibi- 
lities as the organization of bilingual work units, and the introduction 


of French vocabulary and expressions specific to a department or ministry. 


A number of students also considered the number of positions 
identified as bilingual to be excessive, with the result that many 
people participating in French language training feel obligated to learn 
a second language on non-functional grounds merely as a requirement for 
career advancement. The devastating effect of this situation on student 


motivation was also discussed. 


The following table summarizes the comments of Anglophone 


students on continuous language training. 
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5.1.1.2 Language Training Programme 


Anglophone student comments on various aspects of the language 
training programme raised a variety of issues, which has been classified 


into the following major categories: 


Orientation 

General policy and Administration of Language Schools 
Methodology 

Testing and Evaluation 

Language School Personnel 


Psychological Reactions to Language Training 


Orientation* 


Comments on the testing and counselling procedures of the Orientation 
Division comprised 9% of all comments on the language training programme 
and included remarks on both their function and their effect on students. 
Those who chose to comment on the psychological effects of the Orienta- 
tion process felt it to be a most negative experience, "anxiety provo- 


king; discouraging and demoralizing.” 


As to the functions of the Orientation Services, it was sug- 
gested that perhaps changes could be made to improve its helpfulness to 
students. These would include making available to the students suffi- 
cient information concerning their language objectives and methods and 
procedures used in language training, by advising the students earlier 
as to the date of the commencement of language training, and by more 
follow-up with students on training. It was therefore suggested that 
the Orientation Services expand its role, that is, that it not only 
function as a placement service but that it inform and prepare students 


more thoroughly for language training. 


For greater detail on the Orientation process, see Research E. 
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Other questions with implications for the Orientation Services 
such as appropriate bases for classroom groupings and the need for more 


strict selection of students, are discussed below. 
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a) General Policy and Administration of Language Schools 


General policy and administration of the language schools was 
commented upon in terms of class composition, administration respon- 
siveness to student needs, facilities and classroom materials, and 


course design. 


With respect to class composition, many students felt that 
changes were necessary in the rationale determining both the number and 
type of students within each class. Several suggestions were made as to 
how to achieve more homogeneity within groups - whether grouping by norm 
expectation, previous exposure to French or personality and motivation. 
In all instances it was felt that class numbers should not exceed 5 to 6 
students. As well, the need for special remedial classes was expressed, 


in order to deal with specific learning difficulties. 


One difficulty cited by a number of students was the general 
lack of communication between administration and students, which they 
felt could be alleviated if a more responsive attitude were adopted on 
the part of the administration. Specific problem areas included the 
need for information in English for new students, and more consideration 
for the general well-being of the individual student. Also mentioned 


was the need for some provision for vacation while on language training. 


Students also expressed a need for improvement in classroom 
conditions - more comfortable furnishings and air conditioning. Audio- 
visual materials were not thought to be put to good use. Especially 
common was the complaint that classroom tapes were of inferior quality. 
Furthermore, suggestions for better and more frequent use of library 


facilities and television facilities were made. 
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Finally, some students saw the need for the introduction of 
alternative course organization in order to better suit the needs of 
ditferent students. Although somewhat varied in their suggestions, most 
tended to favour a more immersion-like programme, whether it be total or 
partial immersion. Suggestions were made that the length of the course 


should vary to comply with the norm required and/or one's prior exposure 


to French. 
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b) Methodology 


Comments on course methodology comprise 16% of comments on the 
language training programme. Those comments were varied and often 
somewhat contradicted each other. However, in spite of their diversity, 
all seemed to express a concern that the particular methodology to which 
the students were exposed did not suit their particular needs, and that 
on the whole and perhaps as a consequence, classes suffered from a lack 
of variety and flexibility in their activities. Several suggestions 
were presented in order to vary the activity of classes, including more 
individual attention, more home assignments and better use of audio- 


visual material. 
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c) Testing and Evaluation 


Of all the comments on the language training programme 117 
concerned the topic of testing and evaluation. Such comments had to do 
with both on-course evaluation (achievement tests and teacher reports) 
and the LKE (Language Knowledge Examination). In each case dissatis- 


faction was expressed as to both the method of testing and the results. 


As concerns on-course testing, it was felt that laboratory 
testing was unnatural and therefore an unsatisfactory means of evaluation. 
The testing criterion tended to be speed rather than real communication 
ability. Some students differentiated between the definition of "bilingual" 
(communication in both languages) and "officially bilingual" (success in 
passing the LKE). On-course evaluation also included teacher reports, 
which in general were thought to be vague and lacking in concrete 


suggestions for improvement. 


Comments on the LKE indicated that some students felt they 
lacked sufficient information as to both its format and results. 
Students suggested that perhaps the LKE should be different for dif- 
ferent norms, that repetitions should be allowed, and that its results 
should be reviewed with the student. It was suggested that such impro- 
vements might be brought about if the LKE was the responsibility of the 


language school. 
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d) Language School Personnel 


Generally speaking there seemed to exist a reasonable degree 
of satisfaction with the personnel at the language schools. Nonetheless, 
comments were made on both teachers and supervisory personnel, at least 
two-thirds of them concerning to the teachers. Students felt a need for 
the teachers at the beginning levels to be bilingual, saying that many 
difficulties could be resolved and frustration avoided if, when necessary, 
the teacher could speak English. Quality among the teachers was seen to 
vary considerably, some being masterful at their profession, while 
others needed more expertise both in methodology and rapport with students. 
Teacher-student rapport, it was thought, could be improved if teachers 


would spend more time outside class with their students. 


The main difficulty concerning supervisory personnel seemed to 
be one of communications breakdown between student and supervisor. 
Students felt that their needs and desires were not being given suffi- 
cient attention. Furthermore, they were often unable to express their 
views or problems because most senior teachers were unable to speak 
English. The lack of bilingualism at this level was considered to be a 


real stumbling block to communication. 
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e) Psychological Reactions to Language Training 


It is interesting to note what students expressed concerning 
the language learning process and their psychological reactions. Although 
a small percentage, (9%), chose to make comments on their psychological 
reaction to language training, the comments expressed generally negative 
feeling resulting from the feeling that learning was being forced upon 
the students, in their view. Another important point was that feelings 
of anxiety resulted from fears of career consequences if students did 
not achieve their norms. Some students appeared to suffer feelings of 
boredom and frustration due to the forced passivity of language train- 


ing. 
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5.1.2 Commentaries by Francophone students on language training 


5.1.2.1 Bilingualism 


Neither the policy nor the implementation of bilingualism 
sparked much commentary. Less than 20% of the total sampling contained 
comments on bilingualism; in Montreal the percentage was even lower 
(16%). If one compares these statistics to figures for the English 


side, one notes a definite difference in the number of commentaries. 


Commentaries on the implementation of bilingualism are divided 
into three categories: division of funds; standards; and use of the 


second language. 


a) Division of funds 


This category referes to the Ottawa language school where, it 
was believed, there existed a degree of budgetary inequity between the 


funds allotted to the Francophone and Anglophone sections. 


b) Norms 


This question brought forth some comments on the deadline and 
the determined levels. There was diagreement with the predetermined 
period of one year in which to learn the language, where the individual 
was prevented from advancing at his own speed and according to his 


abilities. 


c) Second language use 


Very few comments revolved around this question but questions 
were nevertheless asked on the use of English in positions identified as 
bilingual, and also on the existence of a degree of injustice between 


the status accorded French and English at work. According to one 


student: 


2 BRD) 


"The Francophones seem far more interested in speaking and learning 
the second language. As a rule, Anglophones make little effort. 
I don't put much stock in this kind of bilingualism.". 


Some felt as well that knowing English was of vital importance 


in getting ahead. 


In spite of the seriousness of these questions, it must be 


kept in mind that few people offered any comments. 


TABLE VIII 


Summary of Francophone 
Students’ Comments on Bilingualism 


Number of Comments Percentage of Francophone 
Comments on the Subject Student's Comments 
on Bilingualism 


Norms should be re-examined - 
norm 4 is totally insufficient 3 33 


There are some budgetary inequi- 
ties between the Anglophone 
and Francophone side in the 
Ottawa language school. iz 22 


The one-year maximum line limit 
causes worry 1 11 


Bilingual positions, where English 
is used, are rare 1 11 
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There is little fairness towards 
English and French at work al Li 
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Promotion is easy if one can 
speak English ih 1a! 


TOTAL 9 100 
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5.1.2.2 The language training programme 


a) Administration of the language schools 


Herein are found the greatest number of comments on the 


Language Training Programme; 627. 


Generally speaking, few comments touched on student placement, 
but those which did complained that groups were too big and not homogenous 
enough, as far as the aptitudes and knowledge of the students making up 


the group are concerned. 


The greatest source of discontent among students, especially 
at Montreal, was the physical layout of the school (Ecole Jeanne Mance). 
According to one student, this school was "unhygienic and poorly maintained". 
This affected the students' morale and did not encourage the learning 
process. Both Montreal and Ottawa students criticized the location of 


the schools and the distance they had to travel. 


As far as the organization of the courses is concerned, many 
students suggested an immersion course in an Anglophone milieu. In 
their opinion, this would force them to make worthwhile use of what they 
were learning; learning would then take place much faster. In order to 
improve classroom teaching, greater contact between Anglophones and 


Francophones in practicing the second language should be encouraged. 


b) Methodology 


In spite of the fact that 20% of the comments were observed, 
few of them were directed at the methodology. People seemed for the 
most part happy with the audio-visual method, but they would have 
preferred to see more variety and oral conversation in classroom activities. 
It was felt that more excursions would help to lend variety to these 


activities and students would greatly thereby benefit. 
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c) The teachers 


Only 71% of the students saw fit to comment on the teaching 
staff. The paucity of comments suggests that most of the students are 
satisfied with their teachers and with the method they used. On the 
negative side, a few students saw the frequency of teacher changes as a 


psychological and pedagogical barrier to their learning. 


d) Testing and evaluating students 


Testing and evaluation of students to place on two levels: 
testing during the course; and the final evaluation, the Language 


Knowledge Examination (LKE). 


A few students believed that the purpose of testing was 
valueless. Test results did not provide an accurate measure of the 
knowledge of the second language; the results showed only the ability to 
pass the tests. In other words, the tests had no relevance to levels of 
bilingualism nor to the content of the methodology. Francophones' 
commentaries on the LKE were less vehement and fewer in number than 


those of the Anglophones on this score. 


e) Students’ Attitude and Motivation 


The lack of comments in this category among Francophones (37) 
is perhaps explicable by the greater number of favourable comments. In 
view of comments like "an excellent course", "an interesting course", it 
is unlikely that learning a second language would have psychological 
effects as demoralizing among Francophones as among Anglophones. 
Moreover, if one were to offer possible reasons for the slight number of 
comments on bilingualism, one might wonder if regular contacts or 


acceptance of the second language have any influence here. 
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5.1.3 Comments by Francophones teachers (Ottawa-Hull-Montreal) 


Francophones teachers' comments on bilingualism and the language 
training programme were for the most part quite unfavourable. They 
seemed to express frustration with the present situation and a degree of 


cynicism towards any possibility of changing it. 


The majority of teachers chose to comment on the language 
training programme (75%), but bilingualism, expecially its implantation, 


brought forth 25% of their comments. 


5.1.3.1 Bilingualism 


a) Policy-philosophy 


If the Language Bureau is looked on as the vehicle for arriving 
at bilingualism, the end rather than the means must be reexamined. Such 
are the feelings of those who chose to comment on this section (82). 
Being bilingual is a fine idea, but it is chimerical to teach in order 
to produce bilingual people. At the present time, in view of bilingualism's 
numerous political and practical problems all the Language Bureau is 


doing is to turn out "pseudo-bilingual people". 


b) Implementation 


Bilingualism viewed as allowing each linguistic group to 
express itself in its own language is a worthy thing; but pseudo-bilingualism 
is a purely political gesture. Teaching of the second language is 
impossible if there is no intrinsic motivation, and Anglophones have 
none. ''Instead of wasting so much energy on the Anglophones, why not 
devote all efforts to Francophones who are vitally concerned with 
preserving their language and their culture"? At present, exterior 
motivation, promotional possibilities, the almighty dollar, etc., turn 
out pseudo-bilingual people who look good statistically but who do 


nothing to promote true bilingualism. 
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On the practical level, there are many problems which affect 
the implementation of bilingualism. In actual fact graduates of the 
language school have precious little opportunity to use their new 
knowledge once they are back at work. Many positions identified as 
bilingual do not require the use of French and the student quickly 
forgets what he has learned at school. Some directors, moreover, in 
some departments view the process of language learning as a purely 
administrative formality and do nothing to insist on the use of French 
in their office. In addition, when many Francophones use only English 
at work, how long will it take for the student to lose his new linguistic 


knowledge? 


Orion Sloe The Language Training Programme 


Comments on the language training programme are divided 
into six sections: 

Selection and student placement (orientation) 

Policy and administration of language schools 
Methodology 

Testing and evaluation 

The Personnel of the Language Bureau 


The attitude and motivation of the teachers. 


In the opinion of teachers, the language training programme as 
it now stands could be improved in each of the six categories mentioned 
above. Very few teachers made favourable comments on the way things 
were run in the language schools; almost all were frustrated and even 
depressed by the antipedagogical outlook seen in administrative or 
policy decisions. No importance is granted to the needs of the student 
or the teacher; efficiency and convenience seemed to be the sole priorities 


in decision making. 
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a) Selection and placement of students 


Of all the commentaries on the language training programme, 


only 112% touched on this topic. 


In general, it was felt that students coming to language 
school should be more carefully selected. At present there seem to be 
no criteria carefully observed on the choice of candidates for language 
training, and on the placing students in homogenous groups. In each case, 


there should be some homogeneity and a degree of motivation and aptitude. 


Teachers believed in being realistic; some adults did not 
possess the aptitude necessary for learning a second language, and such 
people should not be accepted into courses. This represented a waste 
of money and energy. Those who showed no motivation should, moreover, be 


compelled to withdraw from courses. 


Some teachers favoured giving a psychological test with the 
purpose of putting students into groups based on motivation, interests, 


and their skill in learning a language. 


No account is taken of age at language schools. Teachers 
deplored the fact that people of 50 years of age or older were required to 
learn another language. In many cases, they were unable to, and even if 


they succeeded they were too close to retirement to make it profitable. 


b) Policy and Administration of language schools. 


The policy and administration of language schools are divided 
into three parts: administrative responsibility towards students' and 


teachers' needs, furniture and equipment, and courses. 
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Summary o 
Students 
The Language 


OB es 


BLE IX 


£ Francophone 
" Comments on 
Training Programm 


Comments 


At the Jeanne-Mance street 
school (Montreal). The 
noise is unbearable and the 
atmosphere is depressing. 


An immersion course in an 
Anglophone milieu would be 
better than the courses given 
in the language schools. 


The location of the schools makes 
long, boring, and tiring 
journeys necessary. In 
Ottawa, a location in Hull 
could have been selected. 


More contact between Anglo- 
phones and Francophones outside 
the classroom is necessary to 
practise English. 


More conversation and variety 
to stimulate conversation 
would be better. 


More excursions to avoid boredom 
in the classroom. 


The audio-visual method is good 
but the material is out of 
date. 


The language courses do not try 
to make students bilingual but 
rather try to make sure they 
pass the test. 


There should be courses during 
the summer. 


Number of Comments 
on the Subject 


11 


Percentage of Francophone 
Students' Comments on 
Language Training Programme 
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18 


10 


a 8on= 


TABLE IX (Cont'd) 


Summary of Francophone 
Students’ Comments on 
The Language Training Programm 


Number of Comments Percentage of Francophone 
Comments on the Subject Students' Comments on 
Language Training Programme 


Seven hours of class is too long 
and teaching is too fast. Ps 3 


Teachers change too often. 2 S 


Students are often poorly grouped 
as far as aptitudes and 
linguistic knowledge is 
concerned. a RASS, 


Groups of eight or more are 
too big. 1 A Ne, 


People from outside Montreal 
should either stay together 
or in a totally Anglophone 


place. Al Le 
One year to learn a language is 

not enough. 1 ae 
More written work is necessary. iL 2 
Teachers need more training. ai 2 


Some teachers are badly 
prepared for their courses. af a 


Giving the same test at all 
levels is unfair. i Asis 


The LKE is too simplistic. 1 2 


Students who don't want to take 
courses shouldn't have to. 1 Ie 


Sending "old people" on language 
training is of dubious value. 1 eS 
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c) Administrative Responsibility towards students' and teachers' 


needs. 


This section contained 4% of all the comments on the language 
training programme. In general, much more importance was put on the 
administrative rather than the pedagogical aspect. Administration 
interfered too much in pedagogical matters, to the point where many 
decisions made in the Language Bureau were anti-pedagogical. Pedagogy 
was the hand-maiden of administration rather than the contrary; all too 
often, the consequence was loss of essential contact between teacher and 


student. 


It was felt that the teaching period should be reformulated, 
in order to allow a rest period at regular intervals (e.g. every three 
months). Such a plan exists in all academic institutions and is necessary 
in order to avoid intellectual saturation. It goes against the best 
interests of pedagogy to make students attend courses for twelve months 


non-stop. 


The same comments were made in regard to daily courses. Six 
hours of course is too much and is hardly propitious to learning. It 


would be better to have four hours of courses and 2 hours of activity. 


d) Furniture and Equipment 


Of all the comments on the language training programme, 7% 
felt it was necessary to improve services, work instruments, and space 


in the language schools. 


It was felt that each school needed a psychological service to 


meet any difficulty the students might have. 


Moreover, schools should be provided with supplementary books 
and newspapers, and teachers should have access to teaching material 
relevant to their course. A number of rooms were judged inadequate, too 


small, and stuffy. There were no rooms where teachers could meet their 
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students for a coffee or where tapes and remedial exercises could be 


prepared. 


e) Courses 


A significant percentage (18%) choose to comment on the course 
structure given at the language schools. A "reformulation" of courses 
was necessary to meet students needs and the requirements of modern 


pedagogy. 


Courses did not take into account the individual's personality; 
they were more geared to groups of people, and individuals who had 
difficulty adapting to this method felt "traumatized". The lack of 
contact with the individual was another result of the size of the 


teaching centres and the suggestion was made that these be smaller. 


Teachers also levelled criticism at the continuous courses. 
It was tiring and stressing to insist that an adult study a language for 
one year, and in the long run this affected his motivation. For this 


reason, cyclical courses would be preferable. 


If there were changes to be made, the great majority of the 
teachers favoured immersion courses in order to wear a bilingual label: 
one must think in French and really live in French. Such was not the 


case in the classroom. 


As far as daily course activities are concerned, several 
changes were suggested: less emphasis on the LKE, more teaching of 
culture and civilization; the laboratory should become an effective work 
instrument; and students generally speaking should be encouraged to do 


more work on their own. 


f) Methodology 


Comments on methodology (9%) showed that teachers wish to have 


greater freedom and flexibility in their teaching. A method per se has 


EERO 


no value; as professionals, teachers should have the right to decide 


what methods they wish to use and how they wish to apply them. 


g) Dialogue Canada 


Dialogue Canada, it was felt, had certain faults. Overall, 
the first level was considered better formulated than the second, but 
both parts contained pictures and illustrations which were badly made 
and hard to relate to the texts. The less tightly structured second 


level offered another barrier to students. 


Even though the importance of the spoken language in the 
classroom is not underestimated, teachers felt that reading, grammar and 


writing should be given more prominence. 


h) Testing and evaluation 


The greatest number of comments in this section (122%) dealt 
with the LKE. Teachers were frankly opposed to all aspects of the LKE: 


purpose, procedure, and results. 


If the LKE purports to measure the candidate's level of 
bilingualism, it does not manage to do so. The LKE measures only 
grammatical correction, not the student's facility of communication. 

The "speaking" part of the LKE should take the form of an interview 
which allows effective evaluation of the speaking ability if it is to be 


truly worthwhile. 


There is a lack of communication between the testing section 
and the teachers, with the result that the LKE contains material which 


is not part of the pedagogy of the language schools (e.g. translation). 


The most unfortunate aspect is the preponderant influence the 
LKE has over the teachers' methodology and the students' attitude. 


Students are concerned with passing the test (LKE) not with learning the 
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language, for a successful result is essential to their being considered 
as bilingual. Teachers feel themselves compelled to students, with the 


result that true learning gives way to passing on "tips" to the students. 


Teachers believed that their progress tests constituted a more 
valuable yardstick for bilingualism; these tests are, moreover, much 
tougher. It is utterly ridiculous for a student to try the LKE four or 
five times, when he fully well knows that there is little difference 


among them. As a diagnostic yardstick, the LKE must be modified. 


1) Language Bureau Personnel © 


The largest number of comments (31%) fell into this section. 
Comments touched on three aspects of Language Bureau personnel: teachers, 


senior teachers, and the work environment. 


A goodly number (18%) of comments concerned teacher training. 
This training was viewed as inadequate. Many teachers did not possess 
the psychological and pedagogical knowledge necessary for teaching a 
second language, especially to adults. The teachers' training session 
was too short. Hiring of teachers left much to be desired, for the 


latter had neither the desired experience nor the interest. 


Steps set out for further training were as important as initial 
training. Teachers felt that they should be given time for research and 
further development. There is at present no programme for development 


within the Language Bureau. 


Teachers recognized the need to be bilingual. Some felt 
indeed that bilingualism was not sufficient, that they should be bicultural 
as well. Bilingualism was necessary for understanding students' linguistic 
difficulties, but biculturalism was equally important in order to under- 
stand the psychological and sociological make-up of the student himself/ 


herself. For these reasons, the position of teacher of French should be 


declared unilingual. 


Set 


The aspect of professionalism sparked a few comments from 
teachers. They felt that their profession as second language teachers 
was held in low esteem at the Language Bureau, and as a result those 
with a determined outlook did not remain there long. The teacher was 
merely a siphon subject to the whims of the departments and such a 
situation caused too high a turnover of teachers and a consequent 


absence of professionalism. 


Comments on the role of senior teachers were few in number 
(9%) but pointed to the need to revitalize their role. The view was 


"understood", and that at the 


expressed that their role was poorly 
present time it seems to be administrative and not pedagogical. Like 
teachers' positions, senior teachers' positions should be designated 


bilingual if they were truly to serve the students. 


Teachers commenting on the work environment (72) stressed the 
fundamentally different character of the Language Bureau in comparison 
with the other offices of the Public Service. The teacher was not like 
other public servants; his daily contact with students called for an on- 
going adaptation to fluctuating situations, and freedom to make appropriate 


decisions. 


Teachers' participation was thus seen as essential in adminis- 
trative decision making; such is not at present the case in the Language 
Bureau. Minimal significance was attached to the teachers' role in 
administrative and pedagogical decisions; this led to depersonalization 


and absence of motivation among the teachers. 
ip) Attitude and motivation of teachers 


8% of the comments in this section discussed the dilemma of 
the language schools: how was it that the teaching was adequate if not 
excellent, yet the results (the students’ achievements were so poor). 
Teachers could not understand how after a full year students knew so 
little and were so ill-suited to communicating in French. They did not 


feel that the teaching was at fault. 
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The failure was accordingly traced to the motivation among 


students. 


The objective of communicating took a back seat; factors not 


relating to linguistics (promotion, money) were accorded priority. 


TABLE X 


Statistics on the Comments 
of Francophone Teachers on Bilingualism 


Percentage of 


Number of Comments on 
Topic Comments Bilingualism 
Bilingualism policy ly 31 
Implementation of 
Bilingualism 38 69 
TOTAL 5D 100 


Percentage of 
all Comments 


Li 


25 
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TABLE XI 


Statistics on Francophone Teachers' 
Comments on the Language Training Programme 


Percentage of 
Comments on 
Number of Language Training Percentage of 
Topic Comments Programme all Comments 


Selection and placing 
students 18 Bit 8 


Policy and administration of ; 
language schools 48 29 Z3 


(Administrative responsibility 
towards the students' and 


teachers' needs) (6) (4) C3) 
(Furniture and Equipment) (12) (7) (6) 
(Courses) (30) (18) (14) 
Methodology 14 9 6 
Testing and evaluation 1!) az 9 
(Testing during the course) (3) (2) (1) 
(LKE) (16) (10) (8) 
Language Bureau personnel aL 31 23 
(Teachers) (30) (18) (14) 
(Senior Teachers) (9) (6) (4) 
(Work environment) (12) (7) (5) 

Attitude and motivation of 
teachers 3 8 6 
TOTALS 163 100 75 
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5.2 RESULTS AND CONCLUSIONS BASED ON QUANTITATIVE ANALYSIS OF DATA 


This section presents and discusses the results of Research B 
which were based on quantitative analysis of data. The results pre- 
sented here include descriptive and predictive statistics which resulted 
from the study of Anglophone candidates undergoing preliminary orient- 
ation, Anglophone and Francophone students on continuous language train- 


ing, and Francophone teachers of continuous courses. 


5.2.1 Descriptive Comparison of Anglophone Candidates Undergoing 
Preliminary Orientation to Languages Training and Anglophone 
Students on Continuous Language Training 


An examination of the discrete and continuous data for Anglo- 
phone students on continuous language training reveals mostly similarities 
(Tables XII-XXIII). The two groups are generally comparable with 
reference to language aptitudes course on the MLAT and PLAB, placement 
level, personality characteristics, and such discrete variables as age, 
sex, and salary ranges. In fact, the only noteworthy differences 
between the two groups are to be found with reference to language 
ability groupings and attitude scores. These are discussed in the 
paragraphs which follow. The overall interpretation of the data is that 
the Anglophone candidates undergoing preliminary orientation and the 
Anglophone candidates on continuous language training may be regarded as 


comparable samples of the same population. 


This leads the authors to the tentative conclusion that the 
Orientation Services performs more a predictive, diagnostic, and coun- 
selling function than a screening function in the sense of precluding 
candidates with poor prognosis from entering language training. It 
leads to the further conclusion that factors which account for candi- 
dates leaving language training before completion are other than those 


on which the above comparisons are based. 
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In terms of general ability, the Anglophone students on con- 
tinuous language training represent a superior group. This is evidenced 
by their scores on the PMA intelligence test, on which the average 
scores of the group are far above the average for the Canadian or 
American population (Table XXIII), and by their high scores on the 
intelligence factor of the 16PF (concrete versus abstract thinking). 
Furthermore, the highest average subtest score on the PMA is the verbal 
score. Considered together, these findings are indicative of a group 
which, though diversified with reference to such factors as occupation, 
age, etc, is quite select in terms of ability. From this viewpoint, to 
the extent that general ability is related to success in language train- 


ing, the prognosis for success should be high. 


In terms of second language aptitude as evidenced by the MLAT 
the Anglophone orientation candidates and the Anglophone students on 
continuous language training are generally comparable, but their average 
scores are substantially lower than might be predicted from their 
general ability level. The average scores of these candidates and 
students correspond to at best the fiftieth centile of the college 
student sample on whom the MLAT has been standardized. Among the reasons 
for the unexpectedly low language aptitude scores in relation to the 
higher general intelligence scores may be the fact that the orientation 
and student groups studied here represent samples of an adult population 
which has been away from the learning environment for some years, and 
which in addition includes many subjects who might be considered above 


the optimal age range for second language acquisition. 


It is noteworthy that, in terms of absolute numbers, the on- 
course student sample contains a greater percentage of subjects in the 
"poor" ability grouping (Table XIX), than the orientation sample, (Table 
XVIII) and a lesser percentage in the "good" ability grouping, something 
which is contrary to what would normally be expected if the Orientation 
Division exerted a screening function prior to course entry, and if the 


language schools requested withdrawal from language courses primarily 
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for candidates Gable to cope with language training on the basis of 
ability and related factors. In fact, failure to perform a screening 
function would normally be expected to yield non-significant differences 
in ability between the two groups. The difference noted here may be 
attributable to the fact that high ability subjects on the average 


require less time to achieve criterion language scores. 


Considering the aptitude scores and also the second factor of 
the 16 PF, which shows the group to be rather inclined towards abstract 
as opposed to concrete thinking, one might hypothesize that such a group 
would tend to become easily bored and frustrated during language training 
unless the rationale for language training is clear and agreed upon, the 
group atmosphere stimulating and congenial, the teaching methodology 
well suited to the individual learner, and teacher competence high. 
Among the concrete steps which could be taken, in this context, to 
minimize frustration and boredom are: homogeneous grouping of students 
according to language aptitude and general interests; smaller class 
sizes; and, designating as bilingual only positions in which there is 
clearly a need to use both official languages of Canada to a significant 


degree. 


The following comments from Anglophone students are repre- 


sentative of many comments received in line with the above suggestions: 


The identification of posts as bilingual should be based on 
actual need for services in the second language. 


I would like to see designated bilingual positions re-examined 
to find out if there is a definite need for a knowledge of 
French or if, in fact, the positions require only minimal use 
of French. 


Although perhaps a difficult thing to undertake, a little more 
consideration should be given to personalities when setting up 
classes and assigning teachers. 
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Consideration of the attitude scores of the groups based on 
the Gardner-Smythe scales reveals, first, that the general attitudes of 
the two samples are relatively positive, and secondly that there is 
nonetheless a trend towards less positive attitudes on the part of the 
students on continuous language training. This trend is observed with 
reference to integrative motivation, instrumental motivation, attitude 
toward learning the second language, attitude toward French Canadians, 
interest in foreign languages, and French use anxiety. It should thus 
be noted that exposure to continuous second language training has not 
resulted in positive attitude change. Rather, there has been a slight 


change toward less positive attitudes. 


In fact, many of the comments received made reference to the 
importance of motivation and attitudes in the context of learning a 
second language. Important though attitudes are in relation to learn- 
ing, they appear to the authors to be even more important to the main- 
tenance and development of the language through its use subsequent to 


the end of formal training. 


Since increasing knowledge of, and exposure to, a second 
language should normally be accompanied by more positive attitudes, as 
demonstrated on a variety of samples in Canada, the United States and 
elsewhere, the authors recommend steps intended to result in positive 
attitude change towards the French language and culture on the part of 


Anglophone students undergoing continuous language training. Among 


these steps could be a more formalized orientation period in the language 


schools prior to the actual start of language training. Some students 
feel lost during the early phases of language training, and this may 
have negative, perhaps long-lasting effects on their attitudes towards 


the second language and culture. 
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An examination of the personality characteristics of orienta- 
tion candidates and Anglophone students on continuous language training, 
based on the 16 PF, reveals the two groups to be similar to each other 
but to differ on a number of significant traits from the North American 
sample on whom this personality test has been standardized. On the 
average, both Anglophone student samples, when compared with the general 
population, are relatively abstract in their approach to problem solving, 
sober and nervous, shy and restrained, relatively dependent and sensitive, 
forthright, somewhat apprehensive and worrying, group-dependent rather 
than self-sufficient, and emotionally responsive (Tables XXII and XXIII). 
As a group they appear to be the sort of people who need a reasonable 
degree of structure in their environment. While some insecurity is in 
fact characteristic of any adult who goes back to study after a number 
of years away from formal education, it can and should be counteracted 
by progressive, carefully planned initiation to the learning environment, 
and adjustment of other aspects of training. This is particularly 
applicable when one is dealing with a group of adults whose stable 


personality characteristics tend toward group dependence and insecurity. 


Although such characteristics as those described cannot of 
course be said to apply to any one individual, they do provide an 
average profile of a conservative and somewhat tense sample of people. 
Such personality characteristics should be taken into consideration in 
planning language courses and teaching methodology. There may also be 
implications in terms of selection of French language teachers, as it is 
possible that the more traditional and conservative of the Anglophone 
students, at least, may be upset by too casual an approach on the part 
of certain French language teachers as indicated by student comments. 

In fact, the comments received reflect both satisfaction with teachers 


and at times frustration. The following comments illustrate both points 


of view: 
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On the whole I find the professors to be well prepared, help- 
ful and enthusiastic. 


Professors are generally well educated and well trained: both 
important. However, personal attitudes of professors are 
terribly important and we find a number of professors are 
separatists and anti-Anglophone. Eventually the attitudes 
come through and become quite apparent. 


In summary, the samples of Anglophone orientation candidates 
and Anglophone students on continuous language training evaluated as 
part of the PFL study are generally comparable. They are intelligent 
and conservative, and generally exhibit positive attitudes and pre- 
dispositions to language training. There is no evidence based on these 
comparisons, however, that language training results in any degree of 


positive attitude change. 
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TABLES Okt 


Anglophone Candidates Undergoing Preliminary Orientation: Occupational 


Variables 
VARIABLE Frequency Percentage SUT eS 
Percentage 
Occupational Function 
ley Senior Executive 2 | get | i 
25 OCLleNntITic. ahd prot: 21 fla 124 
3. Admin. and Foreign 78 Ad GZ 54.6 
Service 
4. Technical 9 4.9 59.5 
5. Admin. Support 63 DAs D550 
6. Operational 12 655 100.0 
Employee Status 
1. Designated 4S 24.1 24.1 
2. Conditional - 142 T7249 100.0 


Internal to PS 
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TABLE XIII 


Anglophone Students on 
Continuous Language Training: 
Occupational Variables 


VARIABLE 


Occupational Function 


We 
2 
oe 


ay Gi 


Senior Executive 


Scientific and prof. 


Admin. and Foreign 
Service 


echnical 
. Admin. Support 


. Operational 


Frequency 


19 
141 
559 


fas 
Zi 
18 


Employee Status (Appointee Flag) 


i 
Zi 


Designated 


Conditional = 
Internal to PS 


Sea GOnGditdonale 


External to PS 


258 
659 


Percentage 


28. 
1A 


=) 


Cumulative 
Percentage 


100.0 
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TABLE XIV 


Anglophone Candidates Undergoing Preliminary Orientation: Personal 


Descriptors 

Cumulative 
VARIABLE Frequency Percentage pepeenvace 
Education 
1. Elementary 3 7 bee 
2. secondary 49 ZLES 2922 
3. Post Secondary 43 24 2 53.4 
4. University 83 46.6 100.0 
Number of Languages 
Spoken 
L... One 132 69.8 69.8 
2a ilwo 43 220 92.5 
Soa ieee - 14 7.4 100.0 
Sex 
1. Male i ey, 65.0 65...0 


2. Female 63 35.0 100.0 
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TABLE XV 


Anglbphone Students On 
Continuous Language Training: 
Personal Descriptors 


ee Frequency Percentage Smut ve 
Education 

1. Elementary 4 <3 25 
2. Secondary 199 2S a2 Ox Se 
3. Post Secondary 195 Zone 46.4 
4. University 459 53.0 100.0 
Number of Languages 

Spoken 

1. One 746 80.7 80.7 
2. Two 138 14.9 95.6 
joe anes 40 4.3 100.0 
Sex 

Male 564 63.4 63.4 
Female 325 36.6 100.0 
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TABLE XVI 


Anglophone Candidates Undergoing Preliminary Orientation: 
Age and Salary Ranges 


Percentage Cumulative 
Vee of Sample Percentage 


Birth Year: 


1907 = 1919 4.8 4.8 
1920 =" 1929 21.4 202 
1930 - 1939 Oak 30% 
1940 - 1949 PRONE 85.0 
1950 - 1970 130 100.0 


Salary Range: 


$4,000 - $6,999 14.2 14.2 
$7,000 - $9,999 yk 555 
€10,000°= "$12; 999 iealgea 44.4 
$13,000 - $15,999 16.7 61g! 
$16,000 - $18,999 Pies 68.5 
$19,000 - $21,999 1.1 79.6 
$22,000 - $24,999 9 89.5 
$25,000 - $27,999 6.8 96.3 
$28,000 - 57 100.0 
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TABLE XVII 


Anglophone Students on Continuous Language 
Training: Age and Salary Ranges 


VARIABLE an ee 
1901 - 1919 De 5635 
1920 - 1929 20.8 Zor 2 
1930 - 1939 Oye Si legen) 
1940 - 1949 Sal ots: 85.9 
1950 - 1970 14.1 100.0 


Salary Range: 


$ OO - $ 3,999 0.1 0.1 
$ 4,000 - $ 6,999 ene) eae 
$ 7,000 - $ 9,999 veo 30.1 
$10,000 - $12,999 13.8 43.9 
$13,000 = $15,999 18.8 C27 
$16,000 - $18,999 8.0 70.8 
$19,000 - $21,999 8.6 TOs 
$22,000 - $24,999 10.0 87.3 
$25,000 — $27,999 4.9 94.1 
$28,000 - 5.9 100.0 
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TABLE XVIII 


Anglophone Candidates Undergoing Preliminary Orientation: 
Variables Related to Language Learning 


VARIABLE Frequency Percentage Bova aee 

First Date PSC L2 

Training 

Pres—qoepe.. 9197.5 40 2052 Zhe2 

Post = Sept. 1973 149 Lone 100.0 

Placement Level 

Ie besson le (levels) | 63 44.1 44.1 

2. Lesson 7 (Level I) 46 worse 10 a 

3. Lesson 17: (Level, 2) 28: 14.7 90.9 

4, stare = (Level IT) 1] Teed 98.6 

5. Lesson 60 - Ensemble Z 1.4 100.0 
pédagogique (Level II) 

Language Ability Grouping 

A. Very Good 18 LO. 102) 

B. Good the: 41.0 Sane 

C. Average 61 54 ed 85.4 

Db. Poox 26 14.6 100.0 
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TABLE XIX 


Anglophone Students on Continuous Language Training: 
Variables Related to Language Learning 


Cumulative 

VARIABLE Frequency Percentage Percentage 
First Date, PSC Ly Training 
Pie > pepe, 1975 Zi 2535 2555 
POSt-= Dept 19/5 709 7607 100.0 
Placement Level 
1. Lesson 1 (Level I) 474 51.9 S59 
2. Lesson 7 (Level I) 238 Zoo 78.0 
oe, Lesson 17 (Level 4) EZ 12.3 90.23 
4. Start - (Level II) 49 5.4 95.6 
5S. Lesson 60 - Ensemble 29 Se 98.8 

pédagogique (Level II) 
6.) “otart — (bevel IT) aly ez 100.0 
Language Ability Placement 
1 Very good 101 Pik if ieeg | 
2 Good 247 Di we 58ao 
3. Average 522 55:35 Tice ® 
4 Poor 238 ZO0e2 1002.0 
Teaching Method 
F 3 Niveau (avancé) 11 IZ We 
F Dialogue Canada (Level I) 208 22.6 2a 
F Dialogue Canada (Level II) 171 UG O70 
F Frang¢ais Courant (Level I) 20 Lie 3921 
F Frangais Courant (Level II) 15 1.6 40.8 
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Table XIX (cont'd) 


VARIABLE Frequency Percentage Sear 

Teaching Method (cont'd) 

F Ensemble pédagogique 425 A6.,2 87.0 

(Level II) 
F Dialogue Canada 4 4 87.4 
programmé (Level I) 

F Traditionnel (Level I) 23 Les 89.9 

F Traditionnel (Level II) 92 1G.0 99 <9 

PY... par blocs (Levelenl) 1 e! 100.0 

Month of Entry on Language 

Training 

On-Training more than one year 38 4.0 4.0 
July 1974 38 4.0 8.0 
August 1974 14 2.0 10.0 
September 1974 al O00 Loa0 
October 1974 10 1.0 14.0 
November 1974 109 12.0 26.0 
December 1974 84 2 Sy) 
January 1975 96 14.0 46.0 
February 1975 81 9.0 Do +0 
March 1975 110 10) 66.0 
April 1975 147 1o.0 82.0 
May 1975 134 L520 o7 a0) 
June 1975 25 5.0 100.0 
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TABLE XX 


Anglophone Candidates Undergoing Preliminary Orientation: 
Major Government Departments 
Represented in Sample * 


DEPARTMENT 


National Defense (Civilian) 
National Health and Welfare 
National Museum of Canada 
Statistics Canada 

Supply and Services 
Environment 

Industry, Trade § Commerce 
National Revenue (Taxation) 
Manpower and Immigration 
Agriculture 

Public Archives 


Other Departments 


nnn nn 


Absolute 
Frequency 


14 
1S) 
15 
13 


12 


82 


Percentage 


*12 most represented departments in sample. 


Cumulative 
Percentage 
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TABLE XXI 


Anglophone Students on 


Continuous Language Training: 


Major Government Departments 
Represented in Sample ~* 


DEPARTMENT 


Supply and Services 

National Health and Welfare 
National Defense (Civilian) 
Statistics Canada 
Environment 

Industry, Trade and Commerce 
Energy, Mines and Resources 
Public Works 

National Revenue (Taxation) 
Manpower and Immigration 


Indian Affairs and Northern 
Development 


Transport (Air) 


Other Departments 


* 12 most represented departments 


in sample. 


Absolute 
Frequency 


66 
64 
56 
54 
47 
43 
36 
33 
32 
SL 
ot 


30 
50 


Percentage 


Cl tN WW Bo = cl G1 Cy Oo, sy 


Cumulative 
Percentage 


100 
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TABLE XXII 


Anglophone Candidates Undergoing Preliminary Orientation: 
Personal Characteristics (Continuous Data) 


VARIABLE Average “ezeTence 
Placement Score (Auditory comprehension) 122.01 - 
MLAT - Number Learning 30.46 Ae 
MLAT - Phonetic Script PASS) 23.0 
MLAT - Spelling Clues 16.96 16.8 
MLAT - Words in Sentences 20:55 26.8 
MLAT - Paired Associates 12.82 16.4 
PLAB - Sound Discrimination 1365 
PLAB - Sound-Symbol Association L649 
16 PF: Reserved - Outgoing 6.28 Se) 
16 PF: Concrete Thinking - Abstract Thinking 6.56 Sie 
16 PF: Easily Upset - Calm Seo Se 
16 PF: Conforming - Independent 509 Dae 
16 PF: Taciturn - Happy-Go-Lucky 4,15 Sig 
16 PF: Expedient - Conscientious Sale 550 
16 PF: Shy - Uninhibited 4.46 See 
16 PF: Self-Reliant - Sensitive 7.24 Sie 
16 PF: Trusting - Suspicious 4.83 Sep 
16 PF: Practical - Imaginative D.92 Sees, 
16 PF: Forthright - Shrewd 4.34 3.5 
16 PF: Placid - Apprehensive 6275 5.5 
16 PF: Conservative - Free Thinking 6.28 56S 
16 PF: Group. Dependent - Self Sufficient 2.38 De2 
16 PF: Casual - Compulsive 5.00 545 
16 PF: Relaxed - Tense 6.18 545 
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Table XXIE (Ceont’ d) 


VARIABL 


16 PF: 
LORE ES 
LOBE: 
LG PE: 


Gardner 


Gardner: 
Gardner: 
Gardner: 
Gardner: 
Gardner: 


Gardner: 


le 

Introversion - Extraversion 
Anxiety 

Level of Emotionality - Tough Poise 


Dependence - Independence 

: Integrative Motivation 

Instrumental Motivation 

Attitude Toward Learning French 
Attitude Towards French Canadians 
Interest in Foreign Languages 
Encouragement from Family § Friends 


French Use Anxiety 


Self-Concept: Identity 


Self-Concept: Satisfaction 


Self-Concept: Personal 


Self-Concept: Social 


Average 


Reference 
Score* 


S197 ICN Ga ECAC Gai CNIS (Cape (Cals Os Om Or 


Pe 
ex te) 1S) 
- WN 
bat Coe ie te rts (CRUE Cr SCE Crs JC Cress (Crimea Crass Chm 


ON 
oo 
ce 


*The reference score in each case represents the mean’ score’ of the 
standardization sample in relation to which the PFL sample scores 


are interpreted, or the neutral point of a bipolar seale, 


ee 


TABLE XXIII 


Anglophone Students on Continuous Language Training: 
Personal Characteristics (Continuous data) 


VARIABLE Average Rracsaees 
Placement Score (Auditory comprehension) 10.38 - 
MLAT - Number Learning 28.48 ony 
MLAT - Phonetic Script ‘ 21.63 25.20 
MLAT - Spelling Clues 16.05 16.8 
MLAT - Words in Sentences 19.45 26.8 
MLAT - Paired Associates Tin 7s 16.4 
PLAB - Sound Discrimination 20.44 13.5 
PLAB - Sound-symbol Association 20524 16.9 
16 PF: Reserved - Outgoing 6.04 ae) 
16 PF: Concrete Thinking - Abstract Thinking 6.33 Bt) 
16>PF: Easily Upset =-Calm 5.34 5 
16 PF: Conforming - Independent 52 ou Deo 
16 PF: Taciturn - Happy-Go-Lucky 4.17 Seo 
16°PE; Expedient = Conse1entious 5.92 ee, 
16 PF: Shy - Uninhibited 4.37 So) 
16, PP: Selt-Réeliant -— Dependent 7 ean, ai 
16° PF: Trusting: - Suspicious 4.81 SES) 
16 PF: Practical- Imaginative Ses, Seo 
16 PF: Forthright - Shrewd 4.69 S50 
16 PF: Placid - Apprehensive 6.70 Saip 
16 PF: Conservative - Free Thinking Ssoo Sry 
16 PF: Group-Dependent - Self-Sufficient eo Deo 
16 PF: Casual - Compulsive Ano ne 
16 PEE Relaxed --Tense 65,19 250 
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Table XXIII (cont'd) 


VARIABLE Average te ali, 
16 PF: Introversion - Extraversion 3520 545 
16 -PF:-Anxiety 5,93 3.5 
16 PF: Level of Emotionality Sa25 Iso 
16 PF: Independence - Dependence ASOT Ce 
Gardner: Integrative Motivation 4.57 Sa 
Gardner: Instrumental Motivation S295 Sao 
Gardner: Attitude Toward Learning French 4.71 aoe 
Gardner: Attitude Towards French Canadians 4.42 JD 
Gardner: Interest in Foreign Languages 4.44 Sao 
Gardner: Encouragement from Family §& Friends Sal CS 
Gardner: French Use Anxiety eee) S20 
Gardner; French Class Anxiety 2.00 aes 
Locus of Control: Internal - External 9.34 ~ 
PMA: Verbal 121.19 100 
PMA: Numerical 117.06 100 
PMA: Reasoning Inka 365 100 
PMA: Spatial 102. 26 100 
Self-Concept: Identity 125.76 1 BAY ae 
Self-Concept: Satisfaction 113529 LO Sd 
Self-Concept: Personal (Deee 64.5 
Self-Concept: Social ete 68.1 


*The reference score in each case represents the mean score of the 
standardization sample in relation to which the PF sample scores 
are interpreted, or the neutral point of a bipolar scale. 


- 115 = 


5.2.2 Factor Analysis of Criterion Measures Employed as Indices of 
Performance in Language Training 


In an effort to determine how many relatively independent 
aspects of performance are represented in the sub-scores yielded by the 
LKE, achievement tests and teacher ratings, it was decided to carry out 
a principal components factor analysis of the criterion measures, 


grouping where possible the Anglophone and Francophone student data. 


Tables XXIV-XXIX present the variables included in this factor 
analysis, the factors obtained, the factor loadings derived from the 


Varimax rotated factor matrix, and some intercorrelations among variables. 


It should be noted that high intercorrelations among the 
subtests of the LKE, among the sub-scales of the average teacher ratings, 
and between the listening and speaking subtests of the achievement 
tests* suggest inability on the part of these instruments to defferent- 
iate with sufficient consistency and precision the reading, writing, 
speaking, and comprehension aspects of language. This is not surpris- 
ing, as these functions are highly interrelated in real life. The 
factor analyses, in keeping with the correlations noted, yielded only 


two interpretable factors. 


The interpretation of the two factors seems puzzling at first, 
in-as-much as placement scores, teacher ratings, and achievement tests 
load significantly on Factor one, while the subtests of the LKE are the 
only variables to load significantly on Factor two. The independence of 
these two factors is illustrated by the correlations between the variables 
which load on Factor ys and those which load on Factor two (Table 
XXVII). These correlations are so low as to be for all intents and 


purposes nil. The lack of relationship between the LKE on the one 


Reading and writing subtest results were not used in the analyses 
because they were not available on the majority of students at 
beginning levels of language training. 
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hand and average teacher ratings, achievement tests, and placement 
scores on the other raises questions as to the equivalence of the skills 
measured by the two sets of variables, as to the relative validity of 
each set of variables in predicting post-training use of the second 
language, and as to the practice of deciding when a student is ready for 
the LKE, based on teacher ratings and achievement tests. Such questions 


require further investigation. 


It is the authors' impression that teacher ratings are more 
influenced by natural observations of the student as a person using the 
second language, while the LKE subtests are more strictly measures of 
second language knowledge attained. Since post-training use of the 
second language may be related only in part to the level of knowledge 
attained but more significantly to willingness or ability to use the 
second language in view of perceived needs and consequences, it may well 
be that teacher ratings or comparable relatively natural observations of 
second language use should be added to the official criterion measures 


used in the evaluation of second language competence. 


The high intercorrelations among the subtests of the LKE, and 
the fact that they load on the same factor, suggest the possibility that 
much time, effort, and money might be saved by using only part of the 
LKE battery. It remains true that a total battery is more reliable than 
its parts, but data presented here do not support the notion that the 


component sub-tests measure different aspects of second language knowledge. 


Finally, based on the results of this factor analysis, the 
decision was reached by the authors to use in the subsequent regression 
analyses as separate criteria only the following variables: sum of LKE 
scores (to be treated separately as attained norms and raw scores), sum 
of average teacher ratings, and sum of average achievement test scores 
(with the exception that no achievement test scores are available for 
the Francophone students). The two criterion factor scores were also 


used as dependent variables in the regression analyses. 


a 


TABLE XXIV 


List of Criterion Variables Employed in the 
Factor Analysis of Criterion Scores and Ratings 


VARIABLE 


Average Achievement Test 
Scores - Listening 


Average Achievement Test 
Scores - Speaking 


Average Number of Lessons 
Covered Per Six Weeks 


Average Teacher Skill 
Rating - Listening 


Average Teacher Skill 
Rating Speaking 


Average Teacher Skill 
Rating - Writing 


LKE Listening Subtest 
LKE Reading Subtest 
LKE Speaking Subtest 
LKE Writing Subtest 


Placement Score 
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TABLE XXV 


Factor Loadings of Criterion Variables from Varimax Rotated 
Factor Matrix for the Factor Analysis of Criterion Variables on 
the Combined Sample of Anglophone and Francophone Students 


Ractorm i; Pactorme: 
eee On-Course Performance LKE Scores 


LKE Reading Subtest 0.90 
LKE Writing Subtest Ons 
LKE Listening Subtest 0.86 
LKE Speaking Subtest O82 
Placement score OnS9 


Average Teacher 
Rating - Reading 


Average Teacher 

Rating - Writing 0.81 
Average Teacher 

Rating - Listening 0.69 
Average Teacher 

Rating - Speaking 0.84 
Average Number of Lessons 

Covered Per Six Weeks 0.87 


Average Achievement Test 
Scores - Listening 0.38 


Average Achievement Test 
Scores - Speaking 0.48 


cater te 


TABLE XXVI 


Factors Extracted From the Principal Components. Factor 
Analysis of Criterion Variables on the Combined 
Sample of Anglophone and Francophone Students 


FACTOR Eigenvalue Percentage of 
Variance 
Factor 1: On-Course Performance 3.59 BH o® 
Factor 2: LKE Scores W255 19.6 


a 
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TABLE XXVII 


Correlations Between On-Course Criterion Variables 
and LKE Scores, on the Combined Sample of 
Anglophone and Francophone Students 


On-Course LKE Reading LKE Writing LKE Listening LKE Speaking 


Variable 

Teacher Rating - G212 Oe Ont) O16 
Reading 

Teacher Rating = Oe1Z 0.14 ea O15 
Writing 

Teacher Rating = Gia Me) G09 O5L0 O12 
Listening 

Teacher Rating - Old 0.09 O.12 Onl 
Speaking 
Achievement Test - 0.00 OF 02 0. OF 0.00 
Listening 
Achievement Test - 0.04 02:05 GZ 0.03 
Speaking 


The threshold of statistical significance at os.01 is .254, and 
at me. 0o7 1s. 195, 
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TABLE XXVIII 


Correlation Matrix Showing the Intercorrelations 
Among Average Teacher Skill Ratings, on the 
Combined Sample of Anglophone and Francophone 


Students 
Teacher Reading Writing Listening Speaking 
Ratings Skills okilise- Skills Skills 
Reading Skills 1.00 0.61 0.462 O65 
Writing Skills 1.00 0.47 O52 
Listening Skills 1.00 0.80 
Speaking Skills 1.00 


* On the Anglophone student population only, the correlations 
between the listening and speaking subtests of the Achieve- 
ment Tests (average scores) was 0.48. 

The: threshold of Statistical significance atic<«.01 15 1254, 
and atcte.05 is .195. 
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TABLE XXIX 


Correlation Matrix Showing the Intercorrelations Among 
the Subtests of the LKE, on the Combined Sample of Anglophone 
and Francophone Students 


LKE Reading LKE Writing LKE Listening LKE Speaking 


LKE Reading 1.00 0.84 0.66 56 
LKE Writing 100 0.44 0.44 
LKE Listening 1.00 0.80 


LKE Speaking 1.00 
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a) Factor Analysis of Variables which may Predict French Language 
Criteria for Anglophone Students on Continuous Language 
Training 


The study of variables which may contribute to the prediction 
of second language attainment on the part of students on continuous 
language courses was a major aim of Research B. Since the number of 
potential predictors available for statistical analysis far exceeded the 
usual number of variables included in stepwise multiple regression 
equations, it was decided as a preliminary step to perform a factor 
analysis of all potential predictor variables. The variables included 


in this factor analysis are listed in Table XXX. 


Eleven factors were extracted, listed on Table XXI and described 
on Table XXXII in terms of the variables which significantly loaded on 


each factor after varimax rotation. 


As may be seen on the above tables, Factor 1 is best described 
as a general aptitude factor. The PMA reasoning subtest has the strongest 
loading on this factor, and all other variables loading on this facotr 
have as their common characteristic the fact that they are to some 
extent measures of general aptitude, regardless of their specific 
content. For further information about the interrelationships among the 
aptitude variables, the reader is referred to the correlation matrix 
shown on Table XXXIII. Specifically, interesting relationships may be 
noted by observing intercorrelations between subtests of the MLAT and 
subtests of the PMA. For example, in general the reasoning subtest of 
the PMA shows moderate correlations with the MLAT subtests, indicative 
of both general and specific factors being present. The variations in 
Magnitude of the correlations between the subtests of the MLAT and each 
of the PMA subtests may help the interested reader to hypothesize 
concerning the aptitude components of the MLAT within the framework of 
Thurstone's conceptualizing about the nature of intelligence. Observa- 


tion of the correlation matrix suggests that if factor analysis with 
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oblique rotations were performed specific aptitude factors would probably 
appear in addition to the general factor. In terms of principal components, 


however, there is a strong general aptitude factor evident. 


Factor 2 is a general attitude factor. On this factor load 
variables related to the individual's attitudes and motivation towards 
the French language and culture, perceived encouragement from family and 
friends in learning the second language, attachment to the office group 
which the individual left in order to undertake language training and 
post-course language skill expectations. The candidate's general 
attitude and motivation to learn the second language is a common deno- 


minator. 


For intercorrelations among the attitude variables, the reader 
is referred to Table XXXIV. It is noted that the Gardner scales, if 
factor analyzed separately from other variables, yield relatively 
independent attitude factors corresponding to the eight individual 
attitude scores. Thus, there are identifiable individual attitude 
variables as well as the general attitude factor which has been identi- 


fied in this principal components factor analysis. 


Factors three to five are personality factors on which major 
loadings are obtained from subtests of the 16 PF and of the Tennessee 
Self Concept scale. Factor 4 is primarily an introversion-extraversion 
variable, with the added characteristic that sujbects who score as 
extraverted on this factor tend also to be tense, apprehensive, and to 
have a relatively low level of self-satisfaction. An introverted person 
may be described as self-sufficient and shy, while an extraverted person 
is socially outgoing and less inhibited. Factor 4 as identified in this 
study should be intepreted as primarily indicative of introversion - ex- 
traversion as a general personality characteristic, with the added 
notion that variables related to degree of nervous tension also load 


substantially on this factor. 
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Factor 3 is primarily indicative of general level of tension 


and anxiety which in turn relates to shyness, conformity, and reserve. 


Factor 5 is primarily indicative of degree of independence as 
a personality trait. On this factor load variables related to self- 
sufficiency, conservatism, and conformity. People scoring high on this 
factor may be regarded as relatively aggressive, independent and self- 


directing as opposed to possessing a relatively passive personality. 


Factor 6 is difficult to label as it is a mixture of indices 
which group together, including age, sex, salary range, and locus of 
control. It has been labeled PSC Success Indices, on the basis that in 
general, older, male, internally controlled individuals appear to be in 


the high salary ranges of the PSC. 


Factor 7 is clearly a general self-concept factor. 


Factor 8 groups together variables which correlate with 
emotional responsiveness. It relates to emotional sensitivity, and per- 


haps tendency to feeling emotional tension. 


Factor 9, here labeled placement level, brings together variables 


which relate to pre-course French language skills. 


Factor 10 relates to the degree of anxiety concerning the use 
of the French language, experienced by Anglophone students whether in 


general or in the context of the classroom. 


On the basis that 10 intepretable factors were identified, 
variables loading on each factor being often relatively independent from 
one another, it was decided to predict criterion French language perfor- 
mance both through independent analyses using individual variables as 
predictors and using factor scores from the above mentioned 10 factors 
as predictors in separate analyses. These results are presented in the 


next section. 
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TABLE XXX 


Items Included in the Factor Analysis of Variables 
Expected to Contribute to the Prediction of Anglophone 
Students! Success on Continuous Language Training 


VARIABLE 


Placement Score: Auditory Comprehension 
MLAT: Number Learning 

MEAT: Phonetic Script 

MLAT: Spelling Clues 

MLAT: Words in Sentences 

MLAT: Paired Associates 

Pimsleur: Sound Discrimination 
Pimsleur: Sound-Symbol Association 
16 PF: Reserved - Outgoing 

16 PF: Concrete - Abstract Thinking 
16 PF; Easily Upset - Calm 

16 PF: Conforming - Independent 

16 PF: Taciturn - Happy-Go-Lucky 

16 PF: Expedient - Conscientious 

16 PF: Shy - Uninhibited 

16 PF: Self-Reliant - Dependent 

16 PF: Trusting - Suspicious 

16 PF: Practical - Imaginative 

16 PFy. Forthright = Shrewd 

16 PF: Placid - Apprehensive 

16 PF: Conservative - Free Thinking 
16 PF: Group-Dependent - Self-Sufficient 
16 PF: Casual - Compulsive 

16 PF: Relaxed - Tense 

16 PF: Anxiety Level 


16 PF: Introversion - Extraversion 
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qabler XXX (Cont'd) 


VARIABLE 


16 PF: Level of Emotionality 

16 PF: Independence - Dependence 
Gardner: Integrative Motivation 

Gardner: Instrumental Motivation 
Gardner: Attitude Toward Learning French 
Gardner: Attitude Toward French Canadians 
Gardner: Interest in Foreign Languages 
Gardner: Encouragement from Family §& Friends 
Gardner: French Use Anxiety 

Gardner: French Class Anxiety 

Locus of Control: Internal - External 
PMA: Verbal 

PMA: Numerical 

PMA: Reasoning 

PMA: Spatial 

Self-Concept: Identity 

Self-Concept: Satisfaction 

Self-Concept: Personal 

Self-Concept: Social 

Locus of Control: Internal-External 
Occupational Level 

Appointee Flag 

Age 

Sex 

Salary Range 

Estimate of High School French 
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Table XxX (cont'd) 


VARIABLE 


IFG: Attachment to the Present Office Group 
IPG eUséfulness of the Second Language in the Work Setting 
IFG: Management Attitudes Toward Use of the Second Language 


IFG: Perceived Reaction of Colleagues of the Second Language Group 
to Use of the Second Language 


IFG: Pre-training Needs for the Second Language Skills 
IPG: Office Group Preference for Use of the First Language 
IFG: Feelings of Loss Upon Leaving Present Office Group 
IFG: Present Use of the Second Language Outside Work 

IFG: GeneraY Satisfaction with Teachers and Teaching 

IFG: Group and Class Cohesion 

IFG: Adequacy of Physical Environment 


IFG: Personal Need for Achievement Channeled into Second Language 
Study 


IFG: Post-Course Second Language Skill Expectations 
Rokeach: Index of Personal Values 


Rokeach: Index of Social Values 
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TABLE XXXI 


Factors Extracted from the Principal Components 
Factor Analysis of Potential Predictor Variables, 
for Anglophone Students on Continuous Language Training 


Eigenvalue Pet Ca eeee 
FACTOR of Variance 
Factor 1: (General, Aptitude 1208 10.0 
Factor 2: General Attitude 6.44 8.4 
Factor 3; Anxiety 4.54 5.9 
Factor 4: Introversion - Extraversion 3.04 Io 
Factor 5: Dependence - Self-Sufficiency 2.68 ae 
Factor 6; Ps Success Indices 2.24 oa) 
Factor 7/3) pel t-Concept Te AW Zia 
Factor 8: Emotionality MR oTAS Zia 
Factor 9; Placement Level 1.68 Divi 
Factor 10: Anxiety About Using French 1.50 Ze0 
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TABLE XXXII 


Factor Loadings of Predictor Variables (Varimax 
Rotated Factor Matrix), for Anglophone Students on 
Continuous Language Training 


VARIABLE Loading Factor 
MLAT: Number Learning 0.62 1 
MLAT: Phonetic Script 0.56 3! 
MLAT: Spelling Clues 0.70 il 
MLAT: Words in Sentences Vane 1 
MLAT: Paired Associates 0.60 1 
Pimsleur: Sound Discrimination 0.54 i 
Pimsleur: Sound-Symbol Association 0.60 1 
16 PF: Concrete-Abstract Thinking 0.45 | 
PMA: Verbal 0.65 1 
PMA: Numerical OO if 
PMA: Reasoning O- 7S 1 
PMA: Spatial OFS I 
LFG: Attachment to the Present Office Group 0.48 Z 
IFG: Present Use of the Second Language O54 37 Z 
Outside Work 
IFG: Post-Course Second Language Skill Oeoo 2 
Expectations 
Gardner: Integrative Motivation 0.85 2 
Gardner: Attitude Toward Learning French 0.78 2 
Gardner: Attitude Toward French Canadians 0.80 2 
Gardner: Interest in Foreign Language 0.76 2 


Gardner: Encouragement from Family and 
Friends 0.68 2 
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Table XXXII(Cont 'd) 


VARIABLE Loading Factor 
ig PES “Easily Upset = Calm -0.57 5 
16 PF: Placid - Apprehensive 0.62 3 
16 PF: Relaxed - Tense 0.65 3 
16 PF: Anxiety Level 0), fH 3 
Self-Concept: Satisfaction -0.45 3 
pelt-Concept; Personal -0.52 5 
16 PF: Reserved - Outgoing 0.55 4 
16 PF: Conforming - Independent 0.50 4 
16 PF: Taciturn - Happy-go-lucky Os75 4 
16 PF: Shy - Uninhibited One, 4 
16 PF: Group-dependent - self-sufficent -0.42 4 
16 PF: Introversion - Extraversion 0.94 4 
16 PF: Conforming - Independent 0.48 5 
16 PF: Practical - Imaginative 0.54 5 
16 PF: Conservative - Free-Thinking 0.57 5 
16 PF: Group Dependent - Self-Sufficient 0.54 5 
16 PF: Independent - Dependent 0293 5 
Age -0.63 6 
Sex -0.62 6 
Salary range -0.69 6 
Locus of Control: Internal - External -0.42 6 
Self-Concept: Identity 0.79 7 
Self-Concept: Satisfaction 0.69 7 
Self-Concept: Personal 0.67 u 
Self-Concept: Social 0.73 ‘4 
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Table XXXII (Cont'd) 


VARIABLE Loading Factor 
Sex -0.41 8 
16 PF: Basily Upset - Cain -0.40 8 
16 PF: Self-Relant - Dependent =0;71 8 
16 PF: Practical - Imaginative -0.42 8 
16 PF: ‘Level of Emotionality 0.88 8 
Placement Score: 0.65 9 
Estimate of High School French -0.40 9 
Gardner: French Use Anxiety 0551 10 


Gardner: French Class Anxiety 0.63 10 
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b) Study of Variables Which May Contribute to the Prediction of 


French language Criteria: for Anglophone Students on Continuous 
Language Training 


This section, using step-wise multiple regression analysis, 
studies the relative importance of variables potentially related to 
success in second language training in terms of their relationships with 
French language criterion scores, and their differential importance in 


predicting the French language criterion scores. 


Based on the previously described factor analysis of criterion 
variables, which yielded two criterion factors (LKE, and scores and 
ratings having to do with performance during language training respec- 
tively) it was decided in this set of regression analyses to predict the 
following four criterion variables: LKE norms attained at the end of 
language training (sum of subtest norms); LKE raw scores attained (sum 
of subscores); teacher skill ratings (average of summed subscales); and 
achievement test scores (average of summed subtest scores). As predictor 
variables, it was decided to use all variables which, in the previsouly 
discussed factor analysis of descriptive and predictor variables, had 
factor loadings of at least 0.40 on one of the factors identified. 

There were two reasons for this decision. First, due to the large 

number of theoretically interesting potential predictive variables 
available for statistical analysis, it was necessary to reduce the 

number of predictors and carry out the regression analyses on a subset 

of these variables. In this context, it seemed reasonable to retain as 
predictor variables those which, through their significant loadings on 

one or more factors, appeared to be sufficiently reliable and to contribute 
a sufficient percentage of variants to the total factor metrics. Secondly, 
the use of these predictor variables only makes it possible to compare 

the relative gains in precision from predictions based on factor scores 
(factor scores were derived from variables with factor loadings greater 


than 0.40) over predictions made from raw scores on individual variables. 


rot Roe 


A sub-sample of 430 Anglophone students who participated in 
the PFL project were, in addition, participants in the questionnaire 
administered by the PSC, SDB studies division in June of 1975. Ques- 
tionnaire responses permitted parallel regression analyses using as the 
criterion a self-evaluation of progress in French while on language 


training. 


The total list of predictor variables used in these regression 
analyses is shown on Table XXXV. In addition, factor scores from the 
factors identified in the factor analysis of descriptive and predictor 
variables were employed in an independent set of multiple regression 
analyses to predict the criterion variables. The factors corresponding 
to these factor scores are described on Table XXXVI. Tables XXXVII-XLIV 
present in order of relative importance the predictor variables which 
contribute significantly and, in the view of the authors sufficiently 


(RSQ change greater than 0.01), to the predictions of criterion scores. 


Overall examination of the regression tables reveals a number 
of noteworthy findings. First, general aptitude and/or language aptitude 
are prominent predictors in all cases. Thus, whether success in language 
training is evaluated through LKE norms, LKE raw scores, achievement 
test scores, or teacher ratings, the students' ability, and perhaps more 
importantly general ability rather than specifically language ability, 
is among the more important predictors of success. In this context, it 
may be noted that the verbally loaded aptitude tests, including the 
language aptitude scores and the verbal and reasoning subtests of the 
PR ‘rather than the non-verbal PMA spatial relations subtest, contribute 


significantly to the prediction of criterion scores. 


Secondly, it should be noted that in the prediction of all 
criteria except the average achievement test scores, predictions based 
on factor scores are more precise than predictions based on individual 
variables. This adds weight to the notion that, in the predictions made 


by the Orientation Services, it may be worthwhile, even if no new 
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predictor variables are introduced, to factor analyze the predictor 
battery currently in use, develop factor score coefficients, and predict 
using factor scores predicted criterion performance better than indivi- 
dual variables lends further weight to the idea that general aptitude 
(perhaps more precisely defined as general verbal reasoning) is to be 
regarded as a predictor of comparable importance to more specific apti- 
tudes. Such tests as the PMA verbal and total score on the MLAT are 


heavily loaded on the general verbal aptitude factor. 


Consideration of predictions based on factor scores show 
introversion - extraversion as contributing significantly to the prediction 
of attained LKE norms and attained LKE raw scores, and anxiety about 
using the French language as a predictor of all criteria. This means 
that the more introverted an individual is, and the less anxious about 
using French as a second language, the more likely he or she to perform 
well in the ratings of French language teachers, in achievement tests, 


and on the LKE examinations. 


The above relationships may be interpretated to signify that 
people who are anxious extraverts by virtue of their personality dynamics 
may be prevented from achieving optimally in the French language courses 
unless steps are taken intended to reduce the degree of expression of 
anxiety. Although it is difficult to state categorically without experimen- 
tation in these matters, it seems reasonable that the following steps 
could be taken to ameliorate aspects of the environment which are poten- 
tially anxiety provoking: re-examination of bilingual positions, retain- 
ing the bilingual classification only for positions in which there is 
clearly demonstrated functional need for the use of both official langua- 
ges; setting less stringent deadlines for the bilingualization of the 
Public Service of Canada, which would be less threatening to the incum- 
bents; an introduction period to the language schools intended to bridge 
the gap smoothly from work to language training; and, awareness on the 
part of the teachers perhaps requiring some in-house training sessions, 
that language training is an axiegenic experience in any case, and that 


excessive anxiety does not lead to optimal performance. 
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Consideration of the variables and factors which are related 
to skill ratings made by teachers reveals the interesting fact that 
teacher ratings are a significant degree related not only to aptitude 
but to such characteristics as age, salary range and other components of 
Factor 6, PSC success indices (Table XLIII). This suggests in effect 
that the French language teachers may rate the student, not only in 
terms of demonstrated skills (although they obviously do this to a 
significant degree and thus their ratings are significantly predicted by 
aptitude), but in terms of the person's total halo as manifested through 
age, sex, and other observable characteristics related to previous 
‘education and salary range. In conclusion, it is interesting to speculate 
whether the above mentioned variables are generally related to ability 
to communicate with people and, if so, whether the teacher ratings may 
in fact be superior predictors of post-course use of the second language 
in comparison to the LKE, which may predict primarily knowledge of the 


second language. 


Finally, the self-ratings based on SDB questionnaire responses 
are of interest in several respects. First, it is of interest to note 
that aptitude and anxiety are predictors, not only of the more objective 
criteria, but also of the students' self-rating of French language 
progress during their training period. Second, it was an unexpected 
finding that dependence - self-sufficiency and occupational group were 
among the significant predictors of French progress self-evaluation, in 
the sense that students who rated themselves higher on French progress 
tended to be more dependent and to belong to lower occupational categories 
than students who rated themselves less highly. (See Tables XII, XLA 
and XLIVA). Although the reasons for this are not obvious, it may well 
be that the rather structured courses offered by the Language Bureau and 
the audio-visual approach followed, may be more in keeping with the 
abilities and expectations of the more dependent and of students from 
lower occupational categories. It is also possible that students from 
lower occupational categories have lower achievement expectations and 


are thus more easily satisfied with their progress on-course than students 
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from the higher occupational categories. Such findings contribute to 
the authors’ impression based on the data presented throughout this 
report that students of different abilities, personality characteristics, 
occupational groupings, and even age ranges may benefit from more 
diversified curriculum offerings which may thus be tailored to somewhat 


more homogeneous sub-groupings of students. 
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c) Study of Selected Variables Which May Contribute to the 
Prédiction of French Language’ Criteria (Teacher ratings and 
achievement tests) for Anglophone Candidates Undergoing 
Preliminary Orientation 


One of the objectives of the present study was to evaluate the 
relative effectiveness of the battery of measures and ratings currently 
used by the Orientation Services in the prediction of student success on 
continuous language training, and to attemps to determine whether a 
combination of aptitude, personality and attitude measures may yield 
more accurate predictions of success on language training courses than 
the presently used combination of aptitude tests and information obtained 


by counsellors in preliminary interviews with candidates. 


Although it was not possible, within the time constraints of 
the PLF study, to obtain LKE information for the sample undergoing pre- 
liminary orientation during the data gathering days of the study, it was 
nevertheless possible prior to final statistic analysis to obtain feature 
skill ratings (listening, speaking and reading) and achievement test 


scores (listening and speaking) for 75% of the orientation sample. 


Each of the above criteria was predicted through a stepwise 
multiple regression analysis, using as predictor variables the information 
obtained by the Orientation Service, consisting of the MLAT (total 
score), the Primsler (summed score), the candidate's age, and the 
quantified results of the preliminary interviews, including both the 
counsellor's prognosis for success on-course, and the major elements 
employed by the counsellor in arriving at the prognosis. These are data 
on judgements concerning mother tongue, linguistic background, degree of 
extrinsic and intrinsic motivation, adaptability to the intended course, 


aptitude for language training, and related judgements. 
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The results of these regression analyses are found on Tables 
XXXIVA and XXXIVB. From these Tables, it is evident that the MLAT is 
the single most important predictor of both criteria. This finding is 
compatible with the finding in the previous section that aptitude is a 
significant predictor of all criteria for Anglophone students on con- 


tinuous language training. 


Age is the second significant predictor of the above two cri- 
teria. In addition, the counsellor's judgements are intrinsic motiva- 
tion and the summed score on the Primsler contributed significantly to 
the prediction of averaged teacher skill ratings. Other judgement data 
obtained during the preliminary interview varied in its degree of re- 
lationship to the criteria in question, but even when relationships to 
the criteria were statistically significant they were subsumed in the 
stepwise multiple regressions to the MLAT, and thus did not contribute 
significantly to the prediction equation. Among these variables is 
found the counsellor's overall prognosis, which correlates with the 
teacher skill ratings to the same degree as the Primsler and age, but 
does not contribute significantly to the prediction equation because of 
its relationship with the MLAT. The same may be said for global coun- 
sellor judgements of aptitude, attitude towards second language learning, 
and mastery of the mother tongue. Thus, the variables listed as sig- 
nificant predictors on Tables XXXIVA and XXXIVB represent the most 


efficient subset of predictor variables. 


As a concluding note, the authors wish to point out the in- 
teresting fact that the intrinsic motivation variable predicts teacher 
ratings but not achievement tests, and when examined more closely is 
found to predict primarily the speaking aspect of the teacher ratings 
(it's correlation to the speaking rating is 0.26, while correlations 
with listening and reading ratings are 0.18 and 0.15 respectively). If 
one considers that the achievement tests, like the LKE, are primarily 


measures of language knowledge while the teacher ratings may be more 
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closely related to the candidate's ability and willingness to use the 
second language as a means of communication, the above finding adds some 
weight to the hypothesis that perhaps attitude measures such as intrinsic 
motivation may contribute significantly to the prediction of those 
criteria which reflect language use rather than language knowledge. In 
this context, one may speculate that attitudinal variables should be 
considered as potential predictors of language use in the work situation 


following language training. 
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TABLE XXXIVA 


Prediction of Average Teacher Skill Ratings (Listen- 

ing, Speaking and Reading) Based on Preliminary 

Orientation Data for Anglophone Candidates Undergoing 
Preliminary Orientation 


Multiple r? Simple 


VARIABLE i eee F 

MLAT: Summed Score Ges Se oni Oise 1Oa6? 
Birth Year 0.42 0105) 60.27 12s 
Intrinsic Motivation 0.44 0502 O,1S 4.05 


Pimsleur: Summed Score 0.46 0.02 O27 3.91 


ane 


TABLE XXXIVB 


Prediction of Average Achievement Test Scores (Listen- 

ing and Speaking) Based on Preliminary Orientation 

Data for Anglophone Candidates Undergoing Preliminary 
Orientation 


Multiple x? Simple 


VARIABLE - Change 7 


MLAT: Summed Score 0.29 0.08 0.29 14.78 
Birth Year 0.36 0.04 0.24 9.29 


VARIABLE 


Age 

Flag 
Gardner: 
Gardner: 
Gardner: 
Gardner: 
Gardner: 
Gardner: 
Gardner: 


Po UPB 
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TABLE XXXV 


Individual Scores Included in the Prediction 
of Criterion Scores Obtained by Anglophone 
Students on Continuous Language Training* 


Attitudes Towards Bilingualism 

Attitudes Towards Learning the Second Language 
Educational Level 

Family Encouragement to Learn Second Language 
Integrative Motivation 

Instrumental Motivation 

Interest in Foreign Languages 


Anxiety 


LOews: @ae Comicicol 


MLAT: Summed Score 


Occupati 
IG PFs 
LO PE 
lo BE? 
te PE? 
HOP is 
lo. PE: 
bo PEs 
Self-Con 


onal Group 

Introversion - Extraversion 
Dependent - Independent 
Emotionality - Poise 
Intellectual Personality 
Self-Reliant - Sensitive 
Shy - Venturesome 

Sober - Happy-Go-Lucky 


cept> social 


Pimsleur: Summed Score 


Placement Level 


ee 


Table yxxy (cont'd) 


VARIABLE 


PMA: Reasoning 

PMA: Spatial Score 

PMA: Verbal Score 

Self-Concept: Identity 

Salary Range 

Second Language Use Anxiety 
Self-Estimate of High School French 


Self-Concept: Personal 


* These variables had factor loadings greater than 0.40 on factors 


identified in the preliminary factor analysis discussed in Section 
A of this Chapter. 


ey = 


TABLE XXXVI 


Factors Employed in the Prediction of Criterion 
Scores Obtained by Anglophone Students on Con- 
tinuous Language Training Using Factor Scores 
Based on Principal Components Factor Analysis 

of the Predictor Variables, With Varimax Rotation 


FACTOR 


Factor 1: “General Aptitude 

Factor 2: Attitude Towards the Second Language and Culture 
Factor 3. Anxiety 

Factor 4: Introversion - Extraversion 

Factor 5: Dependence - Independence 

Factor 6: Socio-Economic Status 

Factor 7: “Self-Concept 

Factor 8: Emotional Sensitivity - Decisive Poise 

Factor 9: Placement Level (Comprehensive) 

Factor 10: Anxiety About Using the Second Language 


Factor 11: Occupational Orientation 


a 


Fee 


TABLE . XXXVII 


Prediction of Attained LKE Norms Based 
on Individual Scores for Anglophone 
Students on Continuous Language Training* 


VARIABLE Multiple r RSQ Change Simple r F 

MLAT: Summed Score 58) eles -.36 eS Seros 
Pimsleur: Summed Score ATs) .01 =. 30 76.44 
Placement Level . 39 Ou eS By LL! 
PMA: Reasoning . 40 (0a -.30 44.60 


*For a listing of all predictor variables included, see Table ’ 
This table lists only predictors which yield a significant F value 
and bring about an R2 change greater than 0.01. 


Soh 


TABLE XXXVIII 


Prediction of Attained LKE Raw Scores 
Based on Individual Scores for Anglophone Students 
on Continuous Language Training* 


VARIABLE Multiple r RSQ Change Simple r F 
MLAT-Summed Score 27) SOK ene T4209 
Pimsleur, Summed Score . 29 SOW » oA 43.69 


*For a listing of all predictor variables included, see Table XXXV. 
This table lists only predictors which yield a significant F value and 
bring about an R2 change greater than 0.01. 
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TABLE XXXIX 


Prediction of Average Achievement Scores Based 
on Individual Scores for Anglophone Students on Continuous 
Language Training 


VARIABLE Multiple r RSQ Change Simple r F 
Age w29 .06 a PAS 61.79 
PMA: Verbal wo 205 «20 56.20 


Pimsleur: Summed Score 25) (OI .19 41.89 
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TABLE. XL 


Prediction of Average Teacher Ratings 
Based on Individual Scores for Anglophone Students on 
Continuous Language Training 


VARIABLE Multiple r RSQ Change Simple r FP 

MLAT: Summed Score Oo aS a0 L357 122 

French Use ‘Anxiety -47 205 =.29 EL2..69 

Placement Level wae, 203 soe SO257 

Age 20 x02 nee iA-95 

TOPE Welimad 2 fol £02 -.06 65.04 
Uninhibited 


PMA: Verbal Oe ROS 5 He} Stott 


SS SS Se 


=e. = 


TABLE XL A 


Prediction of French Language Course 
Progress (Self Evaluation) Based on Individual Scores 
for Anglophone Students on Continuous Language 
Training * 


Multiple r? Simple 


VARIABLE " Change a F 

Post-Course French Skill Oe16 O02 O16" 5.86 
Expectations 

French Class Anxiety Oe22 0.02 -0.16 SiOz 

PMA: Reasoning 0.24 0.01 0.15 Sc we 

Occupational Group O.27 0.01 OF 3.42 


*This analysis is based on the responses of the sub-sample of Anglo- 
phone students on continuous language training who participated in 
both the PFL project and the Studies Division questionnaire (N:430) 
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TABLE XLI 


Prediction of Attained LKE Norms Based on Factor 

Scores Derived from the Factor Analysis of Pre- 

dictors for Anglophone Students on Continuous Lang- 
uage Training 


FACTORS Multiple r RSQ Change Simple r 
General Aptitude ~44 od -.44 
Anxiety About Using 

the Second Language ae ae ra 
Placement Level 49 Ol eae 


Introversion - Extraversion.5] 5 Ol = 5/5 


16235 


Seen 
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TABLE XLII 


Prediction of Attained LKE Raw Scores Based on 
Factor Scores Derived from the Factor Analysis of Predictors 
for Anglophone Students on Continuous Language Training 


FACTORS Multipless RSQ Change Simple r 


General Aptitude . 34 eb2 34 


Anxiety About Using 
the Second Language . 40 »l4 -.20 


Introversion-Extraversion .4l FOL -.10 


44.30 


IOs 2s 


= L555 = 


TABLE XLIII 


Prediction of Average Achievement Test Score Based 
on Factor Scores Derived from the Factor Analysis of Predictors 
for Anglophone Students on Continuous Language Training 


FACTORS Multiple r RSQ Change Simple r F 

General Aptitude 20 .08 28 84.73 
PoG success Indices. OD .04 wall 48.43 
Anxiety About Using - 50 0% -.05 5250 


the Second Language 
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TABLE - XLIV 


Prediction of Average Teacher Skill Ratings Based on 
Factor Scores Derived from the Factor Analysis of Predictors for 
Anglophone Students on Continuous Language Training 


FACTORS Multiple r RSQ Change Simple r F 
General Aptitude ~45 720 »45 513.74 
PSC Success Indices wae . 06 -.25 99.54 
Placement Level ot .06 .24 84.76 
(Comprehensive) 

Anxiety About Using aol .O5 ae 74.86 
the Second Language 

Attitudes Toward the 207 .O1 esta PAUL UNE: 
Second Language and 

Culture 


Anxiety Oo As -.11 18276 
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TABLE XLIV A 


Prediction of French Language Course Progress (Self-Evaluation) 
Based on Factor Scores Derived from the Factor Analysis of Pre- 
dictors for Anglophone Students on Continuous Language Training* 


F 2 A 
FACTORS Multiple r Simple ' 
z Change c 
Anxiety About Using French Oneal 0.04 = Opty aldo 
Dependence - Self-Sufficiency 0.24 0.01 -0.09 3.60 
General Aptitude 0.26 0.01 Oo Oct 


*This analysis is based on the responses of the sub-sample of Anglo- 


phone students on continuous language training who participated in 
both the PFL project and the Studies Division questionnaire (N:430) 
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5.2.3 Francophone Students on Continuous Language Training: Quantitative 
Description, and Study of Variables Which may Contribute to the 
Prediction of English Language Criteria 


This section, like the preceding, presents and discusses the 
quantitative descriptive and predictive data analyzed by Research B with 
reference to the Francophone students on continuous English language 
training during the period of the PFL study. Separate sections present 
and discuss descriptive statistics, factor analysis of potential predictor 
variables, and prediction of criterion performance through the use of 


multiple regression analysis. 


a) Francophone Students on Continuous Language Training: 
Quantitative Description 


Tables XLV - L present the discrete and continuous variables 
in terms of which the on-course Francophone student sample is described. 
Examination of tables presenting discrete variables (Tables XLV and 
XLIX) shows that this sample differs in a number of significant ways 
from the Anglophone student sample previcouly deceviped. Important dif- 
ferences are evident both with respect to occupational function (there 
were no senior executives in this sample, and 65.6 percent of the sample 
was in the administrative support and operational categories, while 
comparable statistics for the Anglophone Sample are 2.2 percent and 33 
percent), and with respect to educational level. Whereas 76.4 percent 
of the Anglophone sample had pos-second or university education, this 
was only true for 45.2 percent of the Francophone students evaluated. 
The average intelligence scores of the two samples likewise reveal large 
and significant differences. Whereas the Anlophone students evaluated 
fall into the superior intelligence range, the Francophones evaluated 
fall into the average intelligence range, obtaining verbal and non- 
verbal intelligence quotients of 96.5 and 99.6 respectively, on tests 
which have been standardized to given an 1I.Q. of 100 as the population 
average. Other differences between the two groups are reflected in the 


statistics describing sex and age. Almost half the Francophone students 
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are female (47%) whereas only 36% of the Anglophone sample are female. 
Approximately 42% of the Francophone sample is age 25 or less, and a 

full 78% is age 35 or less. The comparable percentages for the Anglophone 
sample are 14% and 35%. 


Having stated the above, it is imperative to note that it 
should not be interpreted as reflecting differences between Francophone 
and Anglophone public service employees, but only between Francophone 
and Anglophone samples of students on continuous language training. In 
fact, the Francophone students are not representative of the Francophone 
public service population. Perhaps the most important reason for this 
is that the majority of French Canadians employed by the Public Service 
of Canada are already bilingual, and have probably been bilingual from 
childhood. They do not require language training courses. Anglophone 
public service employees, on the other hand, are generally not bilingual 
and do require language training courses when their positions are classi- 
fied bilingual, or when they aspire to a bilingual position. It is 
important to be aware of such group differences in the design of diagnostic 


and training programmes for the two groups. 


In terms of attitudes and personality characteristics, shown 
on Table L, certain comments appear in oder. First, attitudes towards 
the English language, and interest in learning the English language (as 
rated in the Gardner scales) appear on the average comparable for 
Francophone students have lower (more negative) attitudes towards 
English Canadians than do the Anglophone toward French Canadians. This 
again should not be interpreted as applicable to the Francophone civil 
service population, but only to Francophone students on continuous 


language training. 


Considering the personality characteristics of the Francophone 
students, one finds that they differ from the population on whom the 
test was standardized in a number of ways. They tend to be more sober, 
taciturn and serious, more shy, more dependent and apprehensive, and 


considerably more group-dependent than the general adult population. 
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Thus, some tendency towards apprehension and worrying and towards 
dependence on groups as opposed to self-sufficiency has been noted with 
respect to both the Anglophone and Francophone students on language 


training. 


In terms of implications for language training, the authors 
feel that a student sample with the above characteristics would probably 
benefit from a systematic introduction to the language courses, and from 
reasonably structured courses in which systematic periodic feedback 
would provide knowledge about performance to date and thus lessen tension. 
It is of course important that such feedback be known to be relevant to 


the final criteria by which their performance will be judged. 
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TABLE XLV 


Francophone Students. on 
Continuous Language Training: 


Occupational Variables 


Cumulative 
VARIABLE | Frequency Percentage Percentage 
Occupational Function 
1. * Senior Executive 0 0.0 
Za Bocaentitic sand protessional 5 : 4.0 4.0 
3. Admininistration and Foreign 29 25 ee PADRE 

Service 

4. Technical 9 Tove 34.4 
S. Administrative Support 58 46.4 80.8 
6. Operational 24 19 2 100.0 
Employee Status 
l.y Designated 24 19.2 Tome 
2. ‘Conditional = jinternal 101 80.8 100.0 


EO) |RS 


Francophone Students on 
Continuous Language Training: 


Personal Descriptors 


VARIABLE 


Education 


L. Elementary 

2. secondary 

3. Post Secondary 
4. 


University 


Number of Languages Spoken 


1. One 

2 Two 

& Three 
Sex 

lie Make 


2. Female 


= 1G20> 


TABLE XLVI 


Frequency 


61 
55 


80. 
18. 


ma nN NY DW 


Percentage 


22.0 


47. 


Cumulative 
Percentage 


LOO. 0 


dL 8 
100.0 
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TABLE XLVII 


Francophone Students on Continuous Language 
Training: Age and Salary Ranges 


VARIABLE her UU oe gets Ce aes 
Birth year: ; 
AGS) ON IS Se Nee] dG 16 
1920 = 1929 ee Te 
1930°- 1939 14.5 PANES 
1940 - 1949 5625 DiS il 
U9a0 = 1970 41.9 100.0 


Salary Range: 


$ 4,000 - $ 6,999 14.1 14.1 
$ 7,000 - $ 9,999 Take I A2.2 
$10,000 = $12,999 14.8 57 0 
$13,000 - $15,999 14.8 TEs 
$16,000 - $18,999 hy sce 74.1 
$19,000 - $21,999 tle T3560 


$22,000 - $24,999 ae we 
$25,000 - $27,999 te oe 
$28,000 - 14.8 90.6 
Missing. 9.4 100.0 


a 


TABLE XLVIITI 


Francophone Students on Continuous Language Training 


Variables Related to Language Learning 


Cumulative 

VARIABLE Frequency Percentage Percentage 

First Date, PSC, Lj Training 

Pre = Sepe. 1975 oh Seo BED 

POSt = Sept. 1974 12] 94.5 100.0 

Placement Level 

1. Lesson 1, Contact Canada 62 49.6. 49.6 

2. Review Level I, 38 30.4 80.0 
Contact Canada 

3. Lesson 26, Contact Canada 20 16.0 96.0 

4. Review Level II 4 Se 99.2 
Contact Canada 

5. Lesson 51 (Advanced i .8 100.0 
Language Program) 

Teaching Method 

1. E Contact Canada (Level I) 48 38.4 38.4 

Z. E Contact Canada (Level I1) La 61.6 100.0 


Month of Entry on 
Language Training 


On-Course more than one year 3 2.0 2.0 
July 1974 1 15.0 330 
November 1974 2 220 5.0 
December 1974 LF 1330 18.0 
January 1975 rs Lio 29.0 
February 1975 13 10.0 5930 
March 1975 20 16.0 5p 0) 
April 1975 20 L620 7 At 
May 1975 15 120 83.0 
June 1975 2h. 17.0 100:.0 
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TABLE XLIX 


Francophone Students on Continuous Lang- 
guage Training: Ten Government Departments Most Re- 
presented in Sample* 


DEPARTMENT copa Percentage nee 
Post Office 30 24 24 
National Revenue (Taxation) ibs We 36 
Secretary of State 2 10 46 
National Defense (Civilian) 9 7 53 
Manpower and Immigration 9 7 60 
Supply and Services 8 6 66 
Transport (Air) oh 6 GZ 
Unemployment Insurance Commission 6 5 Td 
Canadian Penitentiary Service 5 4 81 
National Revenue (Customs § Excise) 5 4 85 
Other Departments 18 iS 100 


*10 most represented departments in sample. 
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TABLE L 


Average Scores and Ratings Obtained by Francophone 
Students on Continuous Language Training 


Average Score Rete rence 
ee (Where Appropriate) Score* 


Placement Score (Oral Comprehension) 8.62 

Placement Score (Written Comprehension) 4.48 

Cattell: Non-Verbal Intelligence 96.2 a1 100 
Otis-Ottawa: Verbal Intelligence 99:62 100 
16 PF: Reserved - Outgoing sa Rs, RRS 
16 PR;> Concrete - Abstract Thinking Soa eo 
lo-PFs. Gasily Upset = Calm Sie Dao 
16 PF: Conforming - Independent 554 Dad 
16 PF: Taciturn - Happy-Go-Lucky 4.04 Sad 
16 PF: Expedient - Conscientious 6.37 269 
lo PFs Shy = Uninhibited 4.61 Did 
lo [PES S sélt-reliant.— Dependent FERPA S, S50) 
16 PE: “Irusting = Suspicious Aoi. SAS 
16 PF: Practical - Imaginative 6.52 oe 
16 PF: Forthright - Shrewd 4.68 ono 
16 PF: Placid - Apprehensive 6.60 SIE, 
16 PF: Conservative - Free-Thinking 6.18 She! 
16 PF: Group-Dependent - Self-Sufficient 1.66 Set) 
16 PF: Casual - Compulsive 4.69 oa 
16 PF; Relaxed = Tense 5.88 Dew 
16 PF: Introversion - Extraversion 2.08 365 
16 PF: Anxiety Level 5.84 ar 
lo PPS ) Level of Emotionality eee Dae 
16 PF: Independence - Dependence 4.38 Sis 
Self-Concept: Identity 125.67 Taek 
pelf-Concept: Satisfaction 115.67 Oran 
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Table i. (cont'd) 


Average Score Reference 
VARIABLE (Where Appropriate) Score* 


Self-Concept: Personal Lee Pace 
Self-Concept: Social (ae on 
Gardner: Integrative 4.66 RS 
Gardner: Instrumental 5.96 AS 
Gardner: Attitude toward Learning English 5.06 Ae: 
Gardner: Attitude Toward English Canadians 3.46 5.5 
Gardner: Interest in Foreign Languages 4.74 Se) 
Gardner: Encouragement from Family § Friends 4.09 See 
Gardner: English Use Anxiety Seeks) Mare) 


“the reference score in each case represents the mean score of the standard- 
ization sample in relation to which the PFL sample scores are interpreted, 
or the neutral point of a bipolar scale. 
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b) Factor Analysis of Variables Which May Predict English Language 
Criteria for Francophone Students on Continuous Language 
Training 


Tables LI-LIII summarize the results of the factor analysis of 
variables which were potential contributors to the prediction of Franco- 
phone students' success on English language continuous courses. Ten 
factors were identified, which differ substantially from the factors 
identified when studying the Anglophone student predictor variables. 
Differences between the two analyses are at least partly explained by 
differences in the English and French language versions of the variables 


included. The factors identified are briefly explained below. 


Factor 1 refers to the adequacy of the self-concept. On this 
factor load variables related to the individual's sense of personal 
identity and self-satisfaction, and to the perception of the self in 


social interactions. 


Factor 2 includes variables which express degree of independence 


and self-reliance as a personality trait. 


Factor 3 is labeled degree of conservatism, because this 
appears to be the common denominator unifying the variables which load 
significantly on the factor. These variables consist of occupational 
group, appointee flag personality tendencies towards conservatism vs 


liberalism, and general anxiety. 


Factor 4 has been labeled introversion - extraversion. It 


corresponds to this second order factor of the 16 PF. 
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Factor 5, labeled practicality, has substantial loadings from 
variables expressing how practical or impractical members of the sample 
tested are, and also to what degree they perceive a need for second 


language learning prior to the start of training. 


Factor 6 refers to background and education, grouping together 


appointee flag placement score, educational level, and estimates of high 


school English. 


Factor 7 is probably best defined as sex, on the basis that 
the sex variable has the highest loading on this factor. The other 


variables which load on the factor are sex-related. 


Factor 8 groups together variables which relate to dependence 


on others, particularly groups, as a personality characteristic. 


Factor 9 is a general intelligence factor. Age, and general 
satisfaction with teachers and teaching also load on this factor. The 
probable explanation is that, for the sample in question, the older 
students obtained somewhat higher intelligence scores on the average and 
were generally somewhat more satisfied with the teachers and teaching 


than the younger students. 


Factor 10 relates to personal drive and motivation, as a 


general personality characteristic. 


In keeping with the procedure adopted for the study of Anglophone 
students, it was decided to predict English language criterion performance 
in separate analyses using individual variables and factor scores based 


on the above ten factors as the predictor variables. 


VARIABLE 
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TABLE LI 


Items Included in the Factor Analysis of Variables 
Expected to Contribute to the Prediction of Francophone 
Student's Success on Continuous Language Training 


eee ene 


Placement Score: Auditory Comprehension 


Placement Score: Written Comprehension 


Gare: 


Non-Verbal Intelligence 


Otis-Ottawa: Verbal Intelligence 


16 
16 
16 
16 
16 
16 
16 
16 
16 
16 
16 
16 
16 
16 
16 
16 
16 
16 
16 
16 


PF: 
Po 
Pie 
PR: 
PEG 
PE: 
PE? 
Ps 
BES 
Pia 
PR 
PE: 
PR: 
PE: 
PE 
jel Sa 
Pre 
PF: 
PE 
Pre 


Reserved - Outgoing 

Concrete - Abstract Thinking 
Easily Upset - Calm 
Conforming - Independent 
Taciturn - Happy-Go-Lucky 
Expedient - Conscientious 
Shy - Uninhibited 
Self-reliant - Dependent 
Trusting - Suspicious 
Practical - Imaginative 
Forthright - Shrewd 

Placid - Apprehensive 
Conservative - Free-Thinking 
Group-Dependent - Self-Sufficient 
Casual - Compulsive 

Relaxed - Tense 

Introversion - Extraversion 
Anxiety Level 

Level of Emotionality 


Independence - Dependence 


Self-Concept: Identity 


Self-Concept: Satisfaction 


md 


Table LI (Cont'd) 


Sec ee ee ee 
a ee iets eee ee ee 


VARIABLE 


Se ee ewe an OE A ee oe 


Self-Concept: Personal 

Self-Concept: Social 

Gardner: Integrative 

Gardner: Instrumental 

Gardner: Attitude toward Learning English 

Gardner: Attitude Toward English Canadians 

Gardner: Interest in Foreign Languages 

Gardner: Encouragement from Family § Friends 

Gardner: English Use Anxiety 

Occupational Level 

Appointee Flag 

Age 

Dex 

Salary Range 

Estimate of High School English 

iFG; Attachment to the Present Office Group 

IFG: Usefulness of the Second Language in the Work Setting 
IFG: Management Attitudes Toward Use of the Second Language 


IFG: Perceived Reaction of Colleagues of the Second Language Group to 
Use of the Second Language 


IFG: Pre-training Needs for the Second Language Skills 
IFG: Office Group Preference for Use of the First Language 
IFG: Feelings of Loss Upon Leaving Present Office Group 
IFG: Present Use of the Second Language Outside Work 

IFG: General Satisfaction With Teachers and Teaching 

IFG: Group and Class Cohesion 


IFG: Adequacy of Physical Environment 


= L/ 2 


Table LT (cont'd) 


VARIABLE 


IFG: Personal Need for Achievement Channeled into Second Language Study 
IFG: Post-course Second Language Skill Expectations 
Rokeach: Index of Personal Values 


Rokeach: Index of Social Values 


= Lis = 


TABLES Lil 


Factors Extracted from the Principal Components 
Factor Analysis of Potential Predictor Variables, 


for Francophone Students on Continuous Language Training 


; Percentage 
ROGIER Ereenvalvg of Variance 
Factor 1: Adequacy of Self- concept 6.54 il 7 
Factor 2: Self-Reliance 4.09 Cond 
Factor 3: Expediency/Anxiety 3.28 539 
Factor 4: Introversion - Extraversion 2.68 4.8 
Factor 5S:- Independence 2.61 AL) 
Factor 6: Educational Background Be 4.2 
Factor 7: Sex een 4.0 
Factor 8: Dependence on Groups 2.01 3.6 
Factor 9: Measured Intelligence Pog Sie 
Factor 10: Personal Drive and a2 35e1 


Motivation to learn English 


Ngee 


TABLE LIII 


Factor Loadings of Predictor Variables (Varimax 
Rotated Factor Matrix) for Francophone Students on Con- 
tinuous Language Training 


VARIABLE Loading Factor 


Self-Concept: Identity 0.74 1 
Self-Concept: Satisfaction 0.75 1 
Self-Concept: Personal 0.78 1 
Self-Concept: Social 0.83 Ui 
16 PF: Conforming - Independent 0.54 bs 
16 PF: Self-Reliant - Dependent -0.80 2 
16 PF: Level of Emotionality 0.79 2 
Occupational Group 0.42 3 
Appointee Flag 0.49 5 
16 PF: Taciturn - Happy-go-Lucky O67 3 
lo PF: Expedient) = Conscientious =0297 3 
lo PF: Forthright = Shrewd -0.48 2 
16 PF: Introversion - Extraversion 0.52 Ka 
16 PR: “Easily Upset = Cain 0.70 = 
16°PF: Shy = Uninhibited -0.57 4 
lo PF: Placid - Apprehensive O73 4 
16 PF: Group-Dependent - Self-Sufficient 0.60 4 
16 PF: Relaxed — Tense 0.60 4 
16 PF: Introversion - Extraversion =(0) a2 4 
16 PF: Anxiety Level 0.87 4 
IFG: Perceived Need for the Second Lan- 
guage Prior to the Start of Train- 

ing -0.63 5 
16 PF: Practical - Imaginative 0.56 S) 
16 PF: Conservative - Free Thinking 0.58 5 
16 PF: Dependence - Independence 0.70 9 


ALD a= 


Table LIED (eont"d) 


VARIABLE Loading Factor 
Appointee Flag -0.41 6 
Placement Score: Auditory Comprehension 0.51 6 
Educational Level 0.64 6 
Estimate of High School English -0.70 6 
Sex -0.69 7 
IPGu Perceived Usefulness, of the. Second . -0.39 7 
Language in the Work Setting 
PMA: Verbal Intelligence 0.49 Wf 
IvGr Perceived Impact vor Teaching Methods 0.47 7 
16 PF: Reserved - Outgoing 0.64 8 
16 PF: Group-Dependent - Self-Sufficient -0.67 8 
16 PF: Independence - Dependence -0.40 8 
PFG: OLfice, Group Preference for Use lof -0.50 8 
First Language 
IFG: Group and Class Cohesion 0.45 8 
Age 0575 9 
Non-Verbal Intelligence Oen2 9 
Verbal Intelligence O23 9 
IFG: General Satisfaction with Teachers 0.49 ] 


and Teaching 


IFG: Personal Need for Achievement, Chan- 0567 10 
neled into Drive and Motivation to 
learn English 


Rokeach: Index of Personal Values -0.50 10 
Rokeach:i4 Indéx of ‘Social Values 0.43 10 
Placement Score: Auditory Comprehension 0.54 10 
16 PF: Conforming - Independent 0.40 10 


i 
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c) Study of Variables which may Contribute to the Prediction of 
French Language Criteria for Francophone Students on Continuous 
Language Training 


Based on the factor analysis of criterion variables, it was 
decided to employ as indices of English language criterion performance 
the following: LKE norms attained at the end of language training (sum 
of subtest norms); LKE raw scores attained (sum of sub-scores); and 


teacher skill ratings (average of summed subscales). 


As predictor variables, it was decided to use individually all 
variables which had factor loadings greater than 0.40 on the preceeding 
factor analysis, and in separate analyses factor scores derived from it, 
as well as the subscores obtained from the Gardner attitude scales (not 
included in the factor analysis). The purpose of the prediction analyses 
was to determine the variables and factors which contribute significantly 
to the prediction of criterion scores, and the relative importance of 


the various predictor variables. 


Table LV to LX present the results of the stepwise multiple 
regression analyses. Examination of the Tables based on individual 
predictor variables shows placement level to be an important predictor 
of attained LKE norms and attained LKE scores. Since placement level 
was also found to be a significant predictor of Anglophone student 
criteria, the authors feel that it should be taken into account in 
selecting candidates who should go on continuous language training. It 
may well be that, for beginning adult students with minimal second 
language knowledge, it may not be feasible in many cases to train them 


to the required level of bilingualism within a realistic amount of time. 


In addition, certain attitudinal variables were among the sig- 
nificant predictors of LKE norms and scores, both when predictions were 
based on individual variables and when they were based on factor scores. 


Among these may be noted interest in foreign languages, post-course 


egy = 


skills expectations, personal drive and motivation to learn English as a 
second language, and a factor which combines level of anxiety and a 
tendency towards expediency. Based on these significant attitudinal 
predictors, and on the fact that such variables as attitude towards 
English Canadians, sex, age, independence and imagination, dependence on 
groups, and self-reliance also contributed significantly to the pre- 
diction of LKE socres and norms, the authors conclude that personality 
characteristics appear to play a more important role in predicting the 
second language success of Francophone students than was the case for 

the Anglophone student sample. This may be a function among other 
things, of age, sex, ability, and occupational function differences 
between the Anglophone and Francophone student samples. The Anglophones 
on continuous language training are male in greater proportion, older on 
the average, typically more able and tend to be higher in occupational 
level. Thus, it is suggested that English language teachers should make 
special efforts to consider in their teaching the aptitudes, attitudes, 
and basic personality characteristics of their students. In this context, 
the addition of basic measures of personality and attitudes to the 
battery of tests administered at preliminary orientation would probably 
serve a useful end. More specifically, differences on such variables as 
personal drive and motivation, and level of self-reliance may be used as 
the basis, coupled with aptitude differences, for establishing reasonably 
more homogeneous groupings of students. As an example as to how such 
groupings might be formed, it may be that students who are relatively 
high in group dependence, and related characteristics may require more 
structured pedagogical techniques than students who are low in dependence, 


high in motivation to learn the second language and high in self-reliance. 


Informal comparison of variables related to the average skill 
ratings made by English and French language teachers indicates that 
ratings by both groups of teachers are closely related to the students' 
general aptitude level. Beyond this, such variables as sex, salary 


range, age and anxiety about using the second language show a significant 
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relationship with teacher skill ratings. In other words, such ratings 
appear to be related to personal qualities of the student, and not only 
his or her knowledge of the second language. To the extent that such 
characteristics are in fact correlated with ability to communicate in 
the second language, they are suggestive that teacher skill ratings may 
be useful criteria in the assessment of the students' ability to function 
in the second language, independently of their level of knowledge of 
that language, which appears to be more precisely measured by the LKE. 
It is felt by the authors, as was the case in discussing the Anglophone 
student. results, that some measure of "natural use" of the second lang- 
uage should contribute to the final judgement of student performance, 
since it is the willingness and ability to communicate in the second 
language rather than second language knowledge per se that will lead to 


more bilingualism in the work situation. 


TABLE LIV 
Individual Scores Included in the Predictions 
of 
Criterion Scores Obtained by Francophone Students 
on Continuous Language Training* 


VARIABLE 


Placement Level 

Educational Level 

165PF>° Concrete’ -vAbstract 

16 PF: Taciturn - Happy-Go-Lucky 

16 PF: Shy - Uninhibited 

16 PF: Self-Reliant - Dependent 

16 PF: Introversion - Extraversion 

16"PEs "Anxiety Level 

lo PF: Level of Emotionality 

16 PF: Independence - Dependence 

Gardner: Integrative Motivation 

Gardner: Instrumental Motivation 

Gardner: Attitude Toward Learning English 
Gardner: Attitude Toward English Canadians 
Gardner: Interest in Foreign Languages 
Gardner: Perceived Encouragement from Family and Friends 
Gardner: English Use Anxiety 

IFG: Post-Course English Skill Expectations 
Age 

Sex 


Salary Range 


* These variables had factor loadings greater than 0.40 on factors identified 
in the preliminary factor analysis discussed in section A of this chapter. 
In addition, 8 attitude variables which had been excluded from the factor 
analysis have been included in the regression analysis based on individual 


variables. 
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Table LIV (cont! d) 


VARIABLE 


Appointee Flag 

Cattell: Non-Verbal Intelligence Score 
Otis-Ottawa: Verbal Intelligence Score 
pel£-Concept:' “Identity 

selt-Concept: Satisfaction 
Self-Concept: Personal 


Self-Concept: Social 
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TABLE LV 


Prediction of Attained LKE Norms Based on 
Individual Scores for Francophone Students on Continuous 
Language Training 


—_-_—__—_——— ne ee ee 


Multiple r? Simple 


VARIABLE vs Gieimes. = F 

Placement Level > 08427 0s oe 
Gardner: English Use Anxiety 0.49 0.06 O50 ToeoO 
IFG: Post-Course English Skill 0.54 0205 Oazs 8.74 

Expectations 

Gardner: Interest in Foreign Languages oy 0.04 -9.28 Tan oe 
Gardner: Attitude Toward English Canadians 0.60 0.04 0.107 8.20 
Otis-Ottawa: Verbal Intelligence 0.62 G202 AU IAS meets pos 
Gardner: Integrative Motivation 0.64 OF0Z 0711s 26ntt 
Gardner: Perceived Encouragement by 0.65 O02 OR 2 hls 


Family and Friends 


“For a listing of ‘all predictor variables included, see Table LIV 
This table lists only predictors which yield a significant F value and 
bring about a r” change greater than 0.01. 
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TABLE LVI 


Prediction of Attained LKE Raw Scores Based on 
Individual Scores for Francophone Students on Continuous 
Language Training 


Multiple r Simple 


VARIABLE ¥ Change i 3 

Salary Range 0223 0. O85 6404284425258 
Gardner: Interest in Foreign Languages OF35 G05 0.24 4.85 
ivG: Post-Couxrse Englasp Skill 0.40 0.04 -0.16 eas) 8) 

Expectations 
Sex 0.45 0.04 0.02 4.58 
Placement Level 0.47 0.02 0.16 4.16 
Age Ogat 0.01 8 a 7.24 
Otis-Ottawa: Verbal Intelligence O55 02020-0505 4.58 
Gardner: Encouragement from Family and O55 0.02 -0.07 4.90 
Friends 
Gardner: Integrative Motivation Oar 0.02 ODS a7 56 


*For a listing of all predictor variables, included .sec lable ULV 
This table lists only predictors which yield a significan F value 


and bring about an r Change greater than 0.01. 
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TABLE LVII 


Prediction of the Average Teacher Ratings 
Obtained by the Francophone Student Sample on Continuous 
Training, Based on Individual Predictor Variables* 


: @ ; 
VARIABLE Multiple fr Simple 


rr Change r 
Ottis-Ottawa: Verbal Intelligence Quod ORO Oe Si 
16 PF: Self-Reliance - Dependence OSS QO 047 S.0528 
Placement Level 0.42 0703 0526 
Age 0.44 0.02) 7.0.22 
Gardner: English Use Anxiety 0.48 OF05 3-03 Zi 
Appointee Flag Oc 51 0.03 -0.06 


*For a listing of all predictor variables included, see Table LIV 
This table lists only predictors which yield a significant F value 
and bring about an r Change greater than 0.01. 
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TABLE LVIII 


Prediction of Attained LKE Norms Based on Factor Scores Derived 
from preliminary Factor Analysis for Francophone 
Students on Continuous Language Training* 


VARIABLE 


Personal Drive and 
Motivation to learn 
English 
Conservatism 

Self Reliance 


Educational Background 


Independence and 
Imagination 


Multiple 


r 


Change 


O30 


0.02 


Simple 


=O 561 


-0.24 


Os19 


=o 7 


OS 


4.04 


* For details of the factor analysis, please refer to section A. The 
factors from which the above factor scores were obtained are listed 


ony tables nin. 
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TABLE LIX 


Prediction of Attained LKE Raw Scores Based on Factor 
Scores Derived from Preliminary Factor Analysis for Francophone 
Students on Continuous Language Training* 


——-_----  —<_—<——ooe SS ee 


VARIABLE Multiple r2 Simple F 
r Change 1 
Conservatism: ; 0.34 Ori 0.34 omy 
Personal Drive and 0.47 2 0.10 ey _ 20.66 
Motivation to learn 
English 
Independence and 0.52 OOS -0.23 10.45 
Imagination 
Dependence on Groups 0207 0.05 -0.22 9.41 
Self-Reliance 0.60 0.04 -0.21 8.48 
Educational Background O62 0.03 -0.16 Sao 


* For details of the factor analysis, please refer to section A. 
The factors from which the above factor scores were obtained 
are listed on Table LII 


- 186 - 


TABLE LX 


Prediction of the Average Teacher Ratings Obtained by the 


Francophone Student Sample on Continuous 
Based on Factor Scores Derived from Preliminary Factor Analysis* 


VARIABLE 


Personal Drive and Motiva- 
tion to learn English 


Measured Intelligence 
Educational Background 
Conservatism 
Self-Reliance 


Sex and Salary Range 


Dependence on Grouns 
Anxiety 


Independence and Imagina- 
tion 


x, 


Multiple 


SS SS] S&S & 


x 


~42 


Boe: 
98 
«09 
.65 
“07 
ah) 


a0 


RT| 


Change 


Se oS S&S S&S & © 


Language Training, 


02 


e02 


ale 


Big AS 


For details of the: factor analysis, please refer to section A. 


The 


factors from which the appropriate factor scores were obtained are 


listed on fable LI. 


- 187 - 


Dee 4 Francophone Teachers: Quantitative Description 


This section describes the French language teachers of the 
Language Bureau in terms of personal descriptors, major personality 
characteristics, and attitudes. In addition, it considers certain 
relationships between these descriptors and the teachers’ degree of job 
satisfaction, perception of other teachers, perception of students, and 


feelings about courses and teaching methods. 


Personal descriptors are found on Table LXI. Based on this 
Table, three points are worthy of note. In the first place, the sex 
ratios of French language teachers and Anglophone students are sub- 
stantially different. Whereas only 36% of the Anglophone students are 
female, more than 50% of the French language teachers are female. 
Secondly, there is a substantial age difference when comparing French 
language teachers and their students. In general, the French language 
teachers tend to be younger. Whereas 85% of Anglophone students are 
over 25 years of age, 54% of their French language teachers are 29 years 
of age or less. Thirdly, it should be noted that although the French 
language teachers tend to be young as a group, they are nevertheless 
very well educated compared to a general population when one considers 
their years of scholarity. If one considers not so much their second 
language teacher training but rather their general education, one finds 
that a large number possess university or graduate degrees, and that 


only one case had the minimum of thirteen years of scholarity. 


Description of the French language teachers in terms of 
personality characteristics and basic attitudes if found on Table LXII. 
Based on this data an analysis of the teacher personality characteristics 
reveals a profile which is in most respects similar to that of the 
Anglophone students they teach, in the sense that both groups are abstract 
thinking, sober, shy and sensitive, somewhat shy and apprehensive, and 
group dependent. There are some differences, however. The teachers are 
more imaginative than the Anglophone students, more free thinking and 


more casual. They are also more emotionally responsive according to 


their average scores on the 16 PF. 
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TABLE LXI 


French Language Teachers: 
Personal Descriptors 


Cumulative 
VARIABLE Frequency Percentage Percentage 
Age 
20 to 29 39 54.2 542 
50: to: So 16 PRET 76.4 
40 to 49 13 Leet 94.4 
SU, tO259 4 30 100 
Sex 
Male 33 45.8 45.8 
Female 39 54.2 100 
Number of Years Schooling 
No University Degree 22 30.6 30.6 
Three Year Bachelors. Degree 17 250 Ry ay 
Four Year Bachelors Degree eS) 26.4 80.6 


Graduate Studies 14 LOe5S 100 
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TABLE LXII 


French Language Teachers: 
Personal Characteristics (Continuous Data) 


VARIABLE Average Reference 
Score* 


uw 


ee) AERTS TSR) Weal soap dab My gh ql oat nh seal Wap qh Sah Sal Sal ny eee 
e ° ° e e e ° e e e e e e e e ° e e ° e e ° e 
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16 PF: Reserved - Outgoing ; 

16 PF: Concrete Thinking - Abstract Thinking 
16 PF: Easily Upset - Calm 

16 PF: Conforming - Independent 

16 PF: Taciturn - Happy-Go-Lucky 

16 PF: Expedient - Consciencious 

16 PF: Shy - Uninhibited 

16 PF: Self-Reliant - Sensitive 

16, Pee “lyusting — Suspicious 

16 PF: Practical - Imaginative 

16 PF: Forthright - Shrewd 

16 PF: Placid - Apprehensive 

16 PF: Conservative - Free Thinking 

16 PF: Group Dependent - Self-Sufficient 
16 PF: Casual- Compulsive 

lo PF: Relaxed = Tense 

16 PF: Introversion - Extraversion 

iG PE Anxiety Level 

16 PF: Level of Emotionality - Tough Poise 
16 PF: Dependence - Indpendence 

Gardner: Integrative Motivation 


Gardner: Attitude Toward English Canadians 


ni er eS Wah [Sy tent al ony SSS SY SSS SS SS gl eh ESS a sy al a ON 
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Gardner: Interest in Foreign Languages 
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Table LXII (cont'd) 


ed 


VARIABLE Average antes 
Self-Concept: Identity T2250 WPA | 
Self-Concept: Satisfaction 110.4 OSes 
Self-Concept: Personal 67.4 64.5 
Self-Concept: Social 69.0 GS.1 


*The: reference score in each Case represents the imean score of the 
standardization sample in relation to which the PFL sample scores 
are interpreted, or the neutral poruntsot ai bipolar scale. 


a aes 


The attitude scores of the French language teachers suggest 
that they have high interest in foreign languages, and probably consider 
that a second language should be learned for primarily integrative or 
cultural reasons. However, their attitudes toward English Canadians are 
relatively neutral, and considerably less positive than both their other 
attitudes on the Gardner-Smythe scale, and the corresponding attitudes 


towards French Canadians manifested by the Anglophone students. 


The above personality and attitudinal differences between 
French language teachers and their Anglophone students suggest that, in 
certain cases at least, the more casual, free thinking, and sensitive 
French language teachers may, especially if they have less than positive 
attitudes toward the English Canadian students, experience certain dif- 
ficulties. In the first place, they may find the rather highly struc- 
tured courses to be frustrating and to prevent free expression of their 
more creative urges. Secondly, if the tendency toward a casual persona- 
lity is combined with emotional sensitivity, youth and related traits, 
such teachers may be perceived by the more conservative and older Anglo- 
phone students as brashed and inexperienced. It should be remembered 
that in the usual student-teacher relationship, the teacher tends to be 
not only more knowledgeable in the subject matter being taught but gene- 
rally older, more experienced, and better educated. These characteristics 
normally contribute to the maintenance of respect and acceptance on the 
part of the student, since the teacher-student relationship, even in 
modern, highly progressive education, remains essentially hierarchic. 
In the Language Bureau, the teachers are exceptionally well qualified 
from the viewpoint of general education, but on the other hand their 
qualification are often in areas other than pedagogy or subject areas 
related to language education. In addition, their youth and consequent 
inexperience as a group may to some extent detract from their acceptance 
by the Anglophone students. This is borne out in a number of the comments 
received from the Anglophone students. Finally, it must be remembered 
that even the older French language teachers tend to be frequently in- 
experienced in the teaching of French as a second language, and are in 
many cases relative new comers to the Public Service Commission and to 


the Language Bureau. For further detail, the reader is referred to PFL 


study D. 
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Table LXIII shows a number of teacher perceptions, related to 
students, teachers, and aspects of their job. The job satisfaction 
scores suggest that the French language teachers are only moderately 
satisfied with their current jobs, and that their degree of satisfaction 
does not change with length of time in the Language Bureau. The number 
of reasons for disatisfaction appear in part A of this chapter, as 
Teacher Comments. Among these one may sight the bureaucratic nature of 
the organization in which the teachers must work, which does not permit 
much individuality, even in classroom work, and the high degree of 
structure in the teaching methods employed. In addition, it is quite 
possible that those teachers who are not primarily qualified as second 
language teachers in terms of their educational background may find less 
than optimally satisfying any job as second language teachers. The 


rapid turn-over in the teaching ranks may be a reflection of this. 


If one considers the relative importance accorded by teachers 
to the aspects of a lesson listed on Table LXIII, it appears that for 
Level I at any rate the teachers favour a highly structured lesson which 
stresses aural-oral aspects, and which relatively de-emphasizes free 
expression, creative exercises, and reading and writing. In fact, the 
teachers’ opinions in this area are compatible with the relative emphasis 
given to various aspects of a lesson in Dialogue Canada. In summary, as 
a group the French language teachers appear to accept the method primarily 
in use at the Language Bureau rather than more inovative methods. If 
one considers their personality characteristics which include a tendency 
towards abstraction, free-thinking, and imaginativeness, one wonders at 
this apparent discrepancy. It may be explained on the basis that many 
of the French language teachers are not primarily qualified as second 
language teachers, and thus must accept the only methods with which they 
feel confident. It may also be that the motivation of many teachers to 
put creative effort into the teaching process is limited, which would be 


expected on the basis of limited job satisfaction. 
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Tables LXIV and LXV provide certain perceptions of fellow 
teachers and students. The dimensions rated through bipolar scales, it 
is of interest to note that teachers rate themselves as young, and 
somewhat interested and active. Anglophone students are perceived in 
this context to be older, slightly less interested, and more passive 
than fellow teachers. This coincides both with the real age differences 
which exist between teachers and students, and with the teachers' some- 


what negative perceptions of English Canadians. 


In terms of ideal class composition, as shown on Table LXV, 
teachers appear to prefer a class with some age range but not excessive, 
balanced in terms of the sexes, and having some diversity in terms of 
profession. Teachers do not appear to want an excessively homegeneous 
group in terms of age, sex, or professional category, but on the other 


hand they do not like an excessively heterogenous group. 


oes 


TABLE LXIII 


French Language Teachers: Job Related 


Perceptions 
VARFABLES Average tsi 
Initial Job Satisfaction ah 5 
Current Job Satisfaction D aah 5 
Desire ‘to Retain One Class-for an Entire Course 2.0 3 
Importance Accorded to Each of the Following 
Blements of the Teaching Process: = 

Listening to Tapes 4.5 3 
Explanation of Tape Content 4.5 6) 
Repetition by Students 4.5 i 
Memorization by Students Ao ) 
Oral “Structure Drills 4.8 3 
Free Oral Expression 4.1 3 
Reading Exercises Deo 2 
Writing Exercises 3.4 3 
Creative Language Use 4.0 3 


*These values refer to Level I. 
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In concluding this section on the descriptive analysis of 
teacher characteristics and perceptions, certain correlations appear 
worth noting. A significant correlation was found between attitude 
towards English Canadians and perception of students' motivation (R = 0.29). 
Although the direction of this relationship cannot be expressed with 
certainty, it seems logical to suggest that teachers whose attitudes 
towards French Canadians are positive probably tend to perceive their 
students as being more highly motivated, either because of their more 
positive perception of the Anglophones or because they teach them in 
such a way as to elicit greater motivation. The latter interpretation 
seems logical in view of a second positive correlation, this time between 
teacher attitude to English Canadians and the teacher's experience in 
teaching French as a second language outside the Language Bureau (R = 0.48). 
This relatively high correlation is suggestive that the more experienced 
teachers, who by virtue of their experience may tend to motivate their 
students are also more positive towards English Canadians than less 


experienced teachers. 


In summary, this analysis of teachers characteristics and per- 
ceptions suggests, first, that certain differences between the character- 
istics of French language teachers and their Anglophone students may 
give rise to a relationship between teacher and student which is less 
than optimal. Secondly, the attitudes and job satisfaction expressed, 
as well as certain perceptions of their colleagues, suggest less than 
optimal interest in pursuing second language teaching in the Language 
Bureau as a long term career. This is not suprising, in view of the 
fact that (See PFL Research D) a large percentage of French language 
teachers possess as their principal qualification degrees in areas which 


are only indirectly related to modern language teaching. 
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-TABLE LXIV 


French Language Teachers: Per- 
ceptions of Teachers and Students (Continuous Data) 


VARIABLE 


Perceptions of Fellow Teachers (Using bipolar 
scale: 


Old - Young 
Disinterested - Interested 


Passive - Active 


Reception of Anglophone Students (Bipolar 
Scare) 


Old - Young 
Disinterested - Interested 


Passive - Active 


Average 


Reference 
Score* 


ed Sie 


TABLE LXV 


French Language Teachers: Viewpoints Concerning 
Ideal Class Composition 


VARIABLE Frequency Percentage Sumulative 
Age: 

All Students of Similar Age 2 pres) Bee 
From a Small Range of Ages 45 } Sears 68.1 
Varied Age Composition iS isyers| 87. 
No Preference 9 15.0 100 
Sex: 

Men Only 0 0.0 0.0 
Women Only Zz Te) SEAS, 
Equal Numbers of Men and Women 54 TD 80.0 
More Men Than Women 1 1.4 Oo! 
More Women Than Men 10 14.3 100 
Professional Category: 

All from the Same Category 0) 0 0 
From Similar Categories 44 63.8 63.6 
From Different Categories 20 29.0 92.3. 
No Preference 5 5 100 
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Conclusions 


CONCLUSIONS 


In this section are briefly listed the major conclusions of 
this study. They are based on the descriptive and predictive statistical 
analyses of data, and on the accompanying comments of students and 


teachers. 


Conclusion I: The Anglophone samples evaluated during preliminary 
orientation and during continuous language training are, for all practical 
purposes, comparable. They may be typified as representative samples of 

a general population which is characterized by high general intelligence, 


and personality tendencies towards conservatism and sobriety. 


Conclusion II: The principal roles of the Orientation Service are 
related to prediction of second language achievement, counselling of 
applicants, and recommendations for level of placement and pedagogical 
strategies likely to succeed. The Orientation Service does not appear 
to have a major role in determining whether or not candidates should be 


admitted to language training. 


Conclusion III: The MLAT used for Anglophone candidates is a reasonably 
good predictor and therefore a useful instrument for ability streaming, 
as it is presently used. A similar instrument should be useful for 


placement of Francophone students. 


Conclusion IV: Francophone students on continuous language training 
differ significantly from Anglophone students in terms of average level 
of general ability, job status and age. As a group, the Francophone 
students are younger, and lower in ability level and job status. The 
personality characteristics and attitudes of Anglophone and Francophone 


students, however, are very similar. 


The authors conclude that Francophone students on continuous 
language training are a biased sample on the Francophone population in 


the Public Service Commission, in all likelihood because the more experienced, 


- 202 - 


able and highly placed civil servants are in general fluently bilingual 
and do not tend to require second language courses, By contrast, Anglophone 
public servants of all ages, ability levels, and job classifications are 


found to require second language training. 


Conclusion V: French language teachers are characterized as young, 
relatively inexperienced in language teaching, and only moderately 
satisfied with their jobs. They appear to have high interest in foreign 
languages, but only limited pedagogical training specifically geared to 


second language teaching. 


Conclusion VI: The absence of inter-relationships between teacher skill 
ratings and LKE scores suggests that these instruments may be measuring 
different skills or functions. Based on the items and format of the 
LKE, this instrument should be considered primarily as a measure of 
second language knowledge. Teacher skill ratings, on the other hand, 
may be regarded as relatively informal estimates of ability to employ 
the second language. Further research should be undertaken to verify 
this hypothesis. Serious consideration should be given to the development 
of an official criterion of second language competence which includes 
not only measures of second language knowledge, but also estimates of 
functional competence, that is, ability and willingness to use the 
second language in a variety of situations outside the course setting. 


Knowledge and use of a second language need not be highly inter-related. 


Conclusion VII: In the prediction of second language criterion perfor- 
mance, general aptitude and language aptitude appear to be among the 
more important predictors for both Anglophone and Francophone students, 
and for both "knowledge" and "performance" criteria. Verbal aspects of 
ability appear to be the most effective. Thus, the continuing use of 
the MLAT and related predictors of success on second language training 


is considered by the authors to be justified. 


Conclusion VIII: Although measures of motivation employed in Research B 


were not major predictors of the criteria analyzed, orientation counsellor 
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ratings of intrinsic motivation significantly predicted teacher skill 
ratings, particularly speaking skills. This is compatible with the 
interpretation that motivation and attitudes may relate more to ability 
and willingness to use the second language than to language knowledge 


per se. 


Since ability and willingness to use the second language may 
be especially important to bilingual performance on the job, following 
training, it is suggested by the authors that measures aimed at improving 
motivation for second language learning and use should be undertaken. 
Among such measures, assuring that all positions classified bilingual in 
fact require the use of the second language at the time of classification, 
and more formalized preparation of candidates for entry into language 
schools, including fixed entry dates, should be given serious consider- 
ation. Other such measures may include more homogeneous student groupings, 
screening of candidates with little chance of success in second language 
training, more varied curriculum offerings, and the adoption of criterion 


measures which stress functional second language performance. 


Conclusion IX: An examination of attitudes related to the second language 
and culture, comparing those of Anglophone candidates undergoing preliminary 
orientation and those of Anglophone students on continuous language 
training, suggests that both groups have relatively neutral attitudes 
towards the second language and culture, and that the attitudes of the 

two groups are not significantly different. In fact, Anglophone students 

on continuous language training exhibit slightly less positive attitudes 


than candidates undergoing preliminary orientation. 


Since one of the major goals of second language courses should 
be to bring about positive attitude change, in order to maximize the 
probability of second language use subsequent to the end of formal 
language training, it is suggested by the authors that possible measure 
to bring about positive attitude change towards the second language and 
culture be studied. Although specific suggestions in this area are 


beyond the present research, the authors conclude by noting that, as a 
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pre-requisite to attitude change, students on continuous language training 
must perceive the language training experience, not as a necessary evil, 
but as a relevant experience the objectives of which are functionally 


attainable. 
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From: Dr. H.P. Edwards (U. of Ottawa, PFL), Dr. Michel Gilbert (U. of 
Québec at Montréal, PFL), Ms Frances Smyth (Ottawa Separate 
School Board, PFL), Dr. Mari Wesche (PFL) 


Subject: Your participation in the Research Project on PSC Language 


Training Programmes. Sub-project on language learning. 


You are now taking part in an orientation program for a course 
which has the laudable but difficult goal of helping you to become 
bilingual, in keeping with the requirements of your position. Your 
success in this undertaking will be determined by many factors, some of 
which may be beyond your control. These include teaching methods, 
physical factors such as school facilities and transportation, group 
factors such as the particular classmates and teachers with whom you are 
placed, and individual factors such as your prior experience with language 
learning, your expectations and needs with regard to the second language, 
personal traits which influence your learning approach or "style", and 
factors such as outside demands on your time and energy while you are in 


language training. 


In the ongoing effort to make the PSC language training programme 
more effective for all concerned, an external research team has been 
commissioned by Treasury Board to evaluate the above factors as they 
operate in the continuous course programme of the Language Bureau, and 
to recommend ways of improving this training. As part of this team our 
group is studying the language learning process and how it can be better 


fitted to individual needs. 


This study is independent of the PSC although the PSC is 
cooperating with it, so that we can assure all those taking part that 
none of the data we collect on individuals will become a part of PSC 
records. A special coding system, to which the key will be destroyed 


once data collection is complete, will insure anonymity. 


We would very much appreciate your participation in our research. 


This would involve your taking a series of tests lasting approximately 


= Z12.= 


24 hours on morning, April , beginning at 

8:30 A.M. at the Orientation Division, 177 Nepean (at Bank St.). Please 
report to Room 220. If the results are to be meaningful it is very 
important that we have as near total participation of those asked as 
possible. Your collaboration will be very much appreciated and may well 


contribute to valuable changes for future languages students. 


Your ministry has been informed of this official request for 
your time. If you need any further information or help with arrangements 


feel free to call any of the research group at the following number: 


M. Wesche: 992-4527 (eve: 749-5352) 
F, Smyth: 237-5660 (eve: 232-2336) 
H.P. Edwards: 231-2366 


In addition to eventual improvements in the language training 
Programme which may result from this study, we can provide interested 
participants with their "personality profile" according to the Cattell 
16 PF test of normal personalities. You may request this during testing 


by filling out an envelope with your code and address for later mailing. 


Thank you very much for your help. 
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GENERAL INFORMATION ON THE RESEARCH 


You are being asked to complete these tests and questionnaires 
as part of a project commissioned by the Treasury Board to evaluate the 
PSC language training programme. Your answers to any and all questions 
will be treated in the strictest confidence. Although we ask for your 
Social Insurance Number (or name) on the cover page we do so only to be 
able to associate information from the various tests and questionnaires 
with data gathered at different times. It is important for you to know, 
however, that before the data is examined, all information for each 
individual will be classified according to a code number and the sheets 
containing Social Insurance numbers or names will be destroyed. Even 
the research team will be unable to match the code numbers with Social 
Insurance numbers or names. This system has been designed to insure the 
absolute privacy of your answers and scores, and that there is no possibility 


of information on individuals becoming part of any permanent records. 


The research project includes teams headed by professors from 
the universities of Montréal, Laval, Québec and Ottawa. Information is 
being gathered on many aspects of the language training programme with 
the hope of providing specific recommendations to improve its effectiveness 


for individual students. 


In order for the research findings to truly represent the 
Situation as it exists, we need the cooperation and participation of as 
many students and teachers as possible. Thus even though you are not 
required to participate, we would very much appreciate your doing so. 
If there is a particular item you do not wish to answer you do not have 
to. However, the usefulness of your test or questionnaire will be 
lessened to the extent that you do not answer each item, so you are 
urged to answer as many as possible. If you have questions about any 


items please raise your hand and someone will come to your assistance. 


Those who would like to receive a copy of their "personality 
profile" from the Cattell 16 PF test may request an envelope to self- 


address, using their code number and address. 
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MEMORANDUM 


DATE: January 13th, 1976. 
FROM: Dr. O. Porebski, Professor, Faculty of Psychology. 
TOS Dr. H.P. Edwards, Dean, Faculty of Psychology. 


RE: The procedure to obtain factor scores for the three sets of data. 


The procedure to obtain factor scores was the same for the 


three sets of data. 


A preliminary analysis in each case consisted in eliminating 
most redundant factor dimensions and items. A strict test of significance 
for the number of necessary factors was then introduced. This involved 
the use of Rao's maximum likelihood test of hypotheses as used in his 
canonical factor analysis. Two, three, four, etc. factors were in turn 
hypothesised as adequate to explain the correlation table. The test of 
hypotheses was done with the aid of chi-squared which statistic is known 


to depend on the number of cases in the sample. 


Once the number of necessary factors was determined all items 
not involved in the definition of these factors were eliminated. The 
final analysis provided principal components which were then rotated 
according to the orthogonal varimax principle. It is with respect to 
these rotated dimensions that the individual scores were obtained. Even 
though these factor scores were the usual multiple regression estimates 
there was no error involved in those estimates. The factor scores may 


thus be treated as uncorrelated variables. 


If you have any further questions on the research or comments 
on your experiences in language training, members of the research team 
would be glad to talk with you during breaks. A blank sheet is also 
provided at the end of the last questionnaire for any comments you would 


like to make. 


Many thanks for your co-operation. 
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Tableau XXXIV (suite) 


ee ee 


Utilisation Gardner: 

Relations actuelle de Connaissance Comportement Gardner: Gardner: Gardner: 
avec le la langue prévue de la face a Comportement Intérét Encourage- 
groupe seconde en langue seconde Gardner: 1' apprentis— face aux pour les ment de la 

actuel du dehors du a la fin Motivation sage du Canadiens langues famille et 
bureau travail des cours intégrative frangais frangais étrangeres des amis 


ee ee eee ee ns a ak... te 


Gardner: Intérét pour 


et des amis 


les langues 
étrangéres 1.00 0.45 
Gardner: Encouragement ; 
de la famille © 
1.00 > 
> 
| 
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Le seuil de 1’ importance statistique 4 oc= .01 est de N54 etenarow mm 05, dene). 


TABLEAU XXXIV 


Tableau des intercorrélations entre les variables 
d'attitudes générales concernant les éléves 
anglophones en cours de formation linguistique continue 


a eC ate Snag SSUES enD DLE SNEEDER ES UREN Ls arp ESS 
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Utilisation Gardner: 

Relations actuelle de Connaissance Comportement Gardner: Gardner: Gardner: 
avec le la langue prévue de la face a Comportement Intérét Enc ourage- 
groupe seconde en langue seconde Gardner: 1' apprentis- face aux pour les ment de la 

actuel du dehors du a afin Motivation sage du Canadiens langues famille et 
bureau travail des cours integrative francais frangais étrangéres des amis 


en a a eee a ee aE SEER Mend SRE ee a 


IFG: Relations avec le 

groupe actuel du 

bureau 1.00 0.00 0.26 0.38 0.28 Qa33 0.24 05:26 
IFG: Utilisation ac- 

tuelle de la langue 

seconde en dehors 

du travail 100 0735 0.38 0.28 O53 0.24 Un26 
IFG: Connaissance preévue 

de la langue seconde 
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Set ides hcours 1.00 0.38 meal 0.34 0.43 ont 


Gardner: Motivation 

intégrative 100 0.64 ere) 0.65 0.49 
Gardner: Attitude face a 

l'apprentissage 

du francais F..00 0.60 0.60 0.50 
Gardner: Attitude face 

aux Canadiens 

francais L200 5d 0.45 
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TABLEAU XXXIII 


Tableau des intercorrélations entre l'aptitude linguistique 
et les variables d'aptitudes générales concernant les @léves 
anglophones en cours de formation linguistique continue 
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peer aan ee ee Ree UUme” Um” ea 


MLAT MLAT MLAT Pimsleur: 
Appren- Ortho- MLAT Ordre MLAT Pimsleur: As socia- 
tissage graphe Sens de des mots Asso- Discrimi- tion PMA PMA 
des phoné- l'ortho- dans les ciation nation sons-— PMA Numé- Raison- PMA 


nombres tique graphe phrases des mots acoustique symboles Verbal rique nement Spatial 


MLAT - Apprentissage des 


nombres 1.00 0.43 0.35 0.41 0.44 0.36 0) 3 0.26 10238 0.44 Ome = 
MLAT - Orthographe phonétique 1.00 0.41 0.39 On32 0.39 0.45 O.4zZ5 40225 0.31 nee 
MLAT - Sens de l'orthographe 100 Oxol 0.43 O33 0.44 O54. (0.37 0.49 0.28 
MLAT - Ordre des mots dans 

les phrases 1.00 0.42 0.39 0.40 0.43 0.50 0.52 O.22 
MLAT - Association des mots 1.00 0.26 0.29 Oe SO) Was 0.40 0.24 


Pimsleur: Discrimination 


acoustique 1.00 0.44 Ov26-1:0.33) $o0eSe On2% 
Pmisleur: Association 

sons~symboles 1.00 O36 | 0524") 07.37 0.24 
PMA: Verbal LEO0) O46") POR 0.28 
PMA: Numérique L200" 14-0263 0.48 
PMA: Raisonnement 1.00 Daat 
PMA: Spatial 1.00 
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Le seuil de l'importance statistique a 


X= Olvest de,.254 et, acc = 205, de .195. 
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TABLE IX (Cont'd) 


Pourcentage de commentaires des 
étudiants francophones sur le 
programme de formation linguis- 


Nombre des 


COMMENTATRES i ; 
Commentaires au sujet 


tique 
Sept heures de cours sont trop longues et l'enseignement est trop 
rapide Z 3 
Les professeurs sont changés trop souvent 2 2 
Les €tudiants sont souvent mal classés au point de vue aptitudes 
et connaissances linguistiques 1 i 

| 

Les groupes de 8 personnes ou plus sont trop grands 1 Tes re 
Les gens venant de l'extérieur de la métropole (Montréal), devraient 
étre logés tous ensemble ou bien 4 un endroit uniquement anglophone 1 175 
Une année pour apprendre un langue est insuffisante 1 ts 
Plus de travaux écrits sont nécessaires tl 2 
Les professeurs ont besoin de plus d'entrainement 1 2 
Quelques-uns des professeurs sont mal préparés pour leurs cours 1 2 
C'est une injustice de donner le méme test 4 tous les niveaux 1 Les. 
Le ECL est trop simpliste I r5 
On ne devrait pas endurer aux cours les étudiants qui ne veulent pas 
apprendre 1 Mes 
Divex1ste une validite douteuse d'envoyer “les vieux" apprendre l'anglais 1 1.5 


Total 61 100 
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francophones sur le programme de 
formation linguistique 
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étudiants francophones sur le 
programme de formation linguis- 


COMMENTA TIRES Nombre des — 
Commentaires au sujet 


tique 
ee ene ee ee ee ee eee 
Il existe a 1'école de la rue Jeanne Mance (Montréal) un bruit 
intolérable et une atmosphére déprimante 1 15 
Un cours d'immersion dans un milieu anglophone serait préferable aux | 
cours qui se donnent dans les écoles de langue PA. 18 os 
bo 
L'emplacement des écoles nécessite de longs trajets ennuyants et fati- 
gants. A Ottawa, on aurait pu choisir un endroit a Hull 6 10 
Plus de contact est nécessaire entre les anglophones et les francophones 
en dehors de la salle de classe afin de pratiquer l'anglais 3 5 
Plus de conversation et plus de variété pour stimuler la conversation 
serait mieux 3 5 
Plus de sorties a l'extérieur pour éviter la monotonie en salle de classe 3 5 
La méthode audio-visuel est bonne mais le matériel est démodé, 3 ) 
Le but des cours de langue n'est pas que les étudiants soient bilingues 
mais qu'ils réussissent aux test 5 5 


Les cours ne devraient pas se donner pendant la saison estivale 2 3 


*Sinod SeT 
qe “‘JusuedTnbg Jo JuoweTqnowe ‘sinassayoid sep yo sjqueTpnja sap sutoseq 
SOT STA-B-STA SAT eAISTUTUpe VqITTTqesuodsei :setzied stor} ue sasTATp 


quos senguey ep SeTodg sep uot eIAsSTUTUpe,T Jo enbt3TTod e7 
Sensuel ep Se[Ods Sep UOT ea STUTUpe Jo oNbTITTOg (q 


*‘OUTUTW JTeI9 OITeAJeI eT ap sevad 

TS QIFTTQeqUeA Ans, ‘jUeTeSSTssnei S{TI,s suem ja sed Jueteanod ou st{t 
‘seo Sep UeTq sueq ‘ensue, 2e13ne un sipueadde,p snqtd no sue aquenbuto 
ep sues sep estxe uo,nb eTqejjei3e1 JUeTeANOI sanessejoid sey ‘sanSuetT 


ep SeToOds xne jUoWeTTeEn}oe eiousT uo,Nb AneZOeyZ un Ysa o8e,7 


‘ensue, oun oipueidde e aqT{[Tqey AneT qe ‘s3no3 sanet 


‘uoTJeATIOU ANeT seide,p sjuetTpnje set atednois ep ena us anbt8oToyohsd 


3s903 UN,p UoT}eASTUTUpPe,[ JUeTeSTAOAeJ SAnessajoid senbTenh 


*SsAInod sep AdATJeA 9S ap SasTTqo o91}9 JUSeTeAASep ‘ssagATJOU sed 

JuetTej2g,u Tnb xneao ‘snqtd eq ‘eTsieua,p Je JUesIe,p ajaed oun 4TeI9,90 
*sonsuel[ op sinod ue stTupe eija sed JUeaTeAASp |8U TO-xNad Jo spuodes snsueT 
eun eipueidde anod oatessaoeu opnqztide,[ sed Jueteae,u saz[npe uTeqI99 


enb :se4sTTeet etj9 ATeTTeS T1,nb Jueteko19 sanessejoid sey 


‘opnjtqde,p 

J@ UOTIEATION Op NeSATU UTeII9D uN Jo |VITQUSaZOWOY sUTeIaD oUN A9STXo 
JTeiAep [TT ‘seo sep unoeyo sueq ‘seuesowoy sednois sep suep sjueTp 
-nj2 sep quowsoetd eT Jo ‘SanbTAsTnNZuTT uot Jew1z0Z eT Anod sjepTpueod sep 
uoT}IETaS eT JUeUTIDUOD QATESGO JUSUWe}ITIIS JsSe 9197719 unNoNe,nb sTques 
TE ‘eTTenjoe saney,T y ‘“sensue,T op seToog xne JueUsA sjUeTpNig Sep 


aigAes sn{d uot zDeTEs oUN,p UTOseq eT Te}JUeS UO ‘*TeIQUa3 UY 


*jafns 90 eB Queteqa Y{IT ‘enbtTystn3 


-UT[ uoT}eWIOF ap oumersoid oT ANS seiTejUeMMOD S98T sNnoj of 


SjyUeTpnje Sep JUowsoeTd Ja uoTDeTIS (e 


*SUOTSTOap op sestid seT suep SeiteqjTAotad JueteTques soueUaAUOD 

PT 22 VqTPOROTIJJa,[T seTnes fanessajoad np no Juetpnja,{—[ ep suftoseq xne 
souejziodut,p sed epioo0e ug ‘*senbT zTTod no seATjeAIsTUTUpe sUOTSToap sep 
Sio[T onbtZo8epedtjue joedse,{T ied saupadep oweu Jo SgAjsnaj JUeTeJe snoq 
enbseid onb stpueq fsen3sue, ep seToo9g xne ,seitejje sep, JueweTnorep 

eT 3FeurV.UOD Tnb 9d Us SaeTqeioAeZ Sonbiewlet sep JueTeAe sinessoejoad 

ep ned sezy, “*SguUOTJUSU JneYy-TO ssuTeWOp sep unodeYyd suep onbTATTod 

eT op uotjesoTTowe eun,p JaTeseqtyoad ‘aeTTenjoe oaney,[T eB enbT4sTnsuTT 


uoTJeWIOF op ouMersoAd aT ‘sanessejoid sap uotutdo,{[ segade,q 


Ssinessojoid sap uot eATIOW Jo apnqtIIV 

son3ue,T sop nesing np Toeuuosisg 

uOTJeNTeAY Jo BuUTASIT 

ST SOTOpoyr aw 

sengue,T ap sa[Todag sop uoTIeAIstTuTuUpe Jo enbTITIoOg 


(UOT}eUSTIO) SJUeTpN}e sap JuemMaoeTd Joa uoTI.eTAaS 


:SoTjied xTS ue sasTATp juosS 


aNbTASTNSUTT uotzewAOoZ op owmmea8oid os{— Ans sodAtejUeMMOD say] 


aNbDTISTNSUTT UOTIeUIOY op ommeIs0Ig ST Z'E°T’S 


ZenNDTISTNBUTT UoTITStTnboe sTTeanou 

es oipaed anod [{-}-eipueid Juetpnjzs,[ sduez op usetquoo ‘ste{3ue usa,nb 
Jueutidxe,s su ‘sowpu-—xne ‘tnb *‘{[TeAesq ne souoydoouerzy sop 3TOA uo puenNb 
SINeTTTe,d ‘“‘neasing aneT suep steSueijz np tojtdwe,[T ans Jeqystsut anod 
UsTI JUOF OU STT Jo SSATIEASTUTWUPe VITTeWAOF oUuN suMI0D oNbTASTNsUTT 
UOTJEUAOF Vp saseqs soT JUeteptTsuod tTnb suoizjed sap *saxzvqisTurM suTe 1990 
suep ‘oqstxe [TE ‘sn[d aq °*aToo9,[T ve stadde e [1T,nb 90 aqTA aTTqno AueTp 
-n19,[ 32 stesueijy ap ToTdue,[T Juewresza sed que3txe,u ‘sen3uT[Tq quel 
euUlOD SB9BTJTIJUepT soqjsod sep UsTg ‘*TTeAeI Ne AnoJeA ne s3esstjusadde 
TeAnou np ATAAes os ap uoTsedD0,p ned sai faqt[eeaa us e A TT ‘sansuet 
ep SseToOds sep Senpeis set Anog ‘aUsTNSuTTTq Np uot INdsxKe Us JsSTU PT 


JuezoeFsJe Tnb soweatqoad sap uetq e A TT Senbtjead ueqtd v{t ans 


*oustTn3 


-UTTTG TBIA VT ATOANOWOAd anod usTA UOJ oU stew seNbTASsTAeqAS set usTq 


quesst[duei Tnb sensur{[tq-opnesd sap juestnpoad +930 ‘aeT Top ne asanoo Fit 
‘seqsod xne 33TTTqTssoooer,,[ fenbesutijxe uoTzeAT}OW eT SaTTenqoe eaney ,T 
V ,g94nITNS aneT Jo ensue, AMeT Asanes JUsWeTTeeT JueTNea Tnb sauoyd 
-oouer’y Sep WTjord ne ynoJ 2713}30u sed ou Tonbianod ‘sauoydoTSue sat doaae 
eTsieug,p jue JeT{[tTdses ep net{ ny,, ‘sed juo,T ou souoydoT3ue sat ja 
‘enbesutiajUuyT UOTJeATJOW Sues spuOodaS oNZueT 9uUN,p JUsueUSsTeSUS,T ENT 
-SUT,P eTqQTssodut 3se TI ‘oenbtITTod Juemenbtun 930e un Ysa oustTNSUTTIq 
-opnesd oT stew fasoyds ouuog oun Jsa ‘oen3ueT sadoid es suep teutidxe,s 


qned enbtystnsut{T odnoi3 enbeyd no ‘Taq sumM0d ousTNBUTTTq o7 
UOTINIeXS Us OSTH (q 


*,,SsensuT[tTq-opnesd,, sap onb sen8ue, sap nesiang 

Np AT}A0S WTOA oU UO SoUSTNSUTTTq Np senbTjJeid Ya sanbtATTod sowetq 

-oid seT sno} e& s0ey SaT[enjoer sandy, [ & ied {[eaept un sAaA AST TTeAeI} 
qse,0 ‘senzurTTtq sep eatnpoad e JeustTesue stew S‘eTqeqytTeynos 3103 4sa,9 
‘onSUTTTG e19q *(%8) UOTIDeS 93909 Ans JejUSeMMOD 9p TsToYyD Juo Tnb 

xN8d op SJUSUT}UeS SaeT DUOp jJUOS 9D fAeUuTUeX9e1 Ynez [1T,nNb oipuseqje,{[ ep 
susfou sot sed uou yo JT 0efqo,[T 4sea,0 SowstTNsuT[Tq eT eAputezie,p ushou 


2T JUeJe oMMOD sansue, sep neeing Np eToOI eT a3estAua uo TS 
etydosottyd - enbtitTog (fe 
SUSTNZUTTTG OT T'E°1T'S 


*souuosiod sap soaitequommod sep ¥¢Z ATEITIOTTEe UOT INOIKXe Us sSTU eS 
qnojins ‘oeustn8uT{Ttq eT stew ‘(¥%¢/) enbTyAsTNSuTT uoTJewA0Z ep owwerzs0id 


aT ins jejuemm0D ep TstToyo quo sanesseyoird sep aztsofeu eT 


*JaesueYyo 

BI ep aITITqtssod eT saeaue oustTudD utTe}IeD UN Jo SeTTenjoe UoTIeENITS 

BT DeAe UOTIeAASNAF eT Op AowWTAdxse JquoeTeTques STI ‘“SeTqerzoAezop SQIy 
qaedntd eT anod juatejze enbTAstTNBZuTT uoTIeWAOF op eumeiZo0id aft Jo oustns 


-UITIq eT ins souoydooueijy sanessejoid sap saitejuemMoD soy] 


(TearqUOW — TINH —- eMeI30) SeuoYydooUeI™Z SANessejzoig Sep SeiTeqUoMMIOD ET" 


*oTor un 
qteazonof & aspuodes ensue, eT op uotjeqdeo0e, [ no sxetT[NZei sqoeqUOD sSeT 

IS J1Teiepuewep as uo SowSTNSUTTTG 29T ANS seATejUeMMOD op saqwou jTjed ts 

un ne e A TI aT[Tenbe{,T anod uosteir e[ Ans soeinjzoefuod sap juestey ‘snqtd 

eq ‘epuodveas aen8ue, eun,p o8esstjueidde,[ sutaou0d tTnb 9d usa sauoydoTsue 

SeT zoyo enb ssuoydoouerjy sat zayd sjUeST[TeioWep Tssne sanbTZoToyodsd 

sqjojjo sop ate A [r,nb uetq 3103 JLerze Nop uo ‘, JueSssetaqUT sinod,, 

‘Sano. JueT[Teoxe,, ommod sonbiewet sep jueuetg ‘*seTqeioAejz yo jntd 
SeitTejusmMMOD ep gjUueMsne sn—td eaquou eT aed aenbt{Tdxe,s yreaiinod (y¢) seuoyd 


—O0UPAJF SOT ZeYyd VTA08eIeD 973909 SsUeP SoATejJUSeUMIOD op oenbuew oT 


SJUeTpN}ea Sop UOTIeATIOW Jo 9pnqzTIIV (2 


*jefns owew od ans sauoydoTsue sap 

seitejuewmos set onb sjuenberj Jo squewayea Tssne sed JustTeja,U TDG eT 
JueUIeDUOD soUOYydODUeAZ Sap SoATeJUSMMOD SaT ‘aeTSoToOpoujew eT op nusquosd 
ne Tu ‘oustn8urt[Ttq np sedeqja xne Tu JUeTeIIodde1r vs 9U sjsaq Set ‘ITP 
JUSWeAINyY ‘*SjSseo} xNe ATSSNatl ap 9azTOeded eT JUeTeI}UOMEp Ss}eI[NS|I SeT 
Sapuovss onSuel,t eT op onbt4sTNsuTT souessTeuuOd ANeT ep seT[Teeat sansou 

oun sed jueTej9,U JUeWepuet op sjse} xne sjej[Nsgil say ‘*eTqeTeA 3noj Np 


sed }7e}9,U 3UT}S0eq Np 3nq aT onb QueTesorD squetpnzeg soenbtTend 


°(10a) SenbtTjstTnZuT] saouesstTeuuo) 
op uswexg,[ ‘eTeUTJ woTJeNTeAY,T Je ‘*sinod Use BUTJSez eT :xneoATU 


xnep & WUSeTeSTeyJ 9S SjUeTpN}ea sep UoTIeENTeAY,T Je BUTISO] VT 


SqUeTpNjis Sop UoTReNTeAS Jo BUTISO] (P 


‘asesstjueidde aneT e enbrZ308eped qe enbt3oToyoAsd oToeISsqo un jTeI~a 
Ssinesssjoid sep quswmasueys np souenberj eT onb JueteAnojz} squetpnie 
sonbTenb ‘yTAZe8gu 9JOD Ng “JUeTeAAES 9S STT JUOP spoyjeU eT ep anb uetq 
Tssne sinessejoid sine, ep sqtTeystzes JueTeqa squetpnie set ‘j1iednqtd 

BT anod ‘anb juetera838ns seatejuemmos ep ned Tg ‘*jueUustTasue sd1i0d 


eT ANs JajUSMMOD Oop TSTOYD UO sqUeTpNje sep Y%/ JUsWaTNeS 


queustesue sdio9g (@) 


*dnoonesq jJuetereqezoad 

Us squeTpNjs SeT 32 SaTATIOe Sad AeTAeA e JUaTeIepte ‘uo-qrTefoI19 
“ineTi9}xX9,T @ SeT}IOS op SsNTq ‘eSseTo op eTTes use sazTATIOe set suep oTeio 
uoTzesieAu0d ep sn—td Jo 2g3EaTIeA op sntd astTnporquUT uo,nb juetTeseuTe 

STT STeW SaTTENSTA-oOfpne spoyjzoW eT op JueqUOD 91}9 JUSTeTQuas sus’ saT 
‘qaednq{d eT Anog ‘oeTZ8o0Topoyjew eT op yefns ne saguuop aja uo soqgaou05 


suoTjse33ns op ned ‘saj0u 339 JUeTe SeiteqUemM0D sep xQz enb aa3TeW 


aTSoTOpoyjaW (4 


*apuodes an8ue,t eT rzoenbtje1id op utjze 

souoydoTsue sat Jo sauoydoouerzj sat oijue 4oOePIUOD ap sntd ATeIe8eANCGOUS 
uo ‘esse[o. op eT[Tes ue ytTey os tnb oe8esstjueidde,[ JeAoTTowe Aanog *aqTa 
snqtd dnoonesq Jreat{dwoooe,s e8esstjueidde Jodo Jo Jueteueadde s{t,nb 

99 AOST[TIN JuUSUTeIA e JTeAeSTTGO seT ‘sTt-juetTekord *tT9e9 6*auoyd 
-O[T3ue NeT[TW uN suep UOTSIeUNIT,p SAnod un gia3B8ns UO sjuUeTpNiea sap 


eiquou pueis un ‘sanod sep uot JesTuesIO,[T suAeDUOD Tnb 90 ug 


‘aquUesTIeF DDUeISTP ANST Oo BpoMMODUT SdTOD2 sap juUsMaD 

-eTdwe,[ JUueTeANOA] eMeII0,P XNBeD JUSMWETeSa Ja TestUOW ep sjUeTpPNIE sey 

> ,esesstqueidde,[ suep tJopte set e sed onqtazjuo. ou jo sjUeTpNje sop Teiow 
eT ans 313e eTeD ‘nuejezJUeTewW Jo enbTUusTSAy uUoU,, 4JTe9 JUeTpPNIeg UN 
uoTas SeTode 99999 *(a0UeW oUUeef eTODq) eT099,T ep enbtsdAyd joedse,T 


qteqa ‘TeerzqUOW e JnoVANs ‘sjuUeTpNjie sep Tnuue puejzas snqtd oT 
-adnoi3 np otjied Juestey squetpnie 
Sep soduesstTeuuod Jo sepnqtjde ena ap jutod ne seuasomoy ned ja spuei3 
doiq sodnoi3 sep queteustetd vs ‘4Tey JUO,T Tnb xneo steu ‘sjueTpnjes sep 


quowesetd eT JueTeqTel SeATeqUemIOD sp ned sea} ‘TeAzgues uy 


*JueAnoi, A,s sartTejuemod sep 479 SenbtTASTNSUTT uoTJew1OY eT ep 


euMeIZO01Ig eT Ans saatTejUewMOD esp eT103g}e0 ojseA sntd eT 389,) 


anZue, op SeTOds Sep UoT}eISTUTUpy (Be 


OeNbTASTNSUTT uUoTIeWAO, op oMMeASOTgG 9T C°?*T'S 


TABLE VIL 


Sommaire des commentaires des étudiants 
francophones sur le bilinguisme 


COMMENTAIRES Nombre des Commentaires au Ola meee UNS 
Sui des €tudiants francophones 
Ujec ts : 
sur le bilinguisme 
Une étude des normes est requise... norme 4 est complétement 
insatisfaisante 3 55 
Il y a de l'injustice budgétaire entre le cété anglophone et franco- 
phone 4 l'école de langue a Ottawa 2 22 
La date limite d'un an cause de 1'inquiétude 1 igi 
[e) 
Postes dit bilingues, oti on utilise de l'anglais, sont rares 1 15) . 
Il existe peu de justice entre l'anglais et le francais au travail 1 if) 
La promotion est facile Si on sait parler anglais 1 it 


Total 9 100 


*soitTejuowmmod sad JTey JUO sues ep siqwou 4TJed se1iq un,nb sreTeddes 


89s eweU puenb ynejzZ TI ‘suotqsenb sod sp V4TAeIZS eT V18TeW 


*uoTjouoId eT e oTeTpiowmtid asouejiodmt aun AtTeAe 


sTeTZue,[ ep souessteuuod aun,nb Tssne JuetTeAoio suas seuTeji99 


*,sed stozo 4,u of ‘austn3ut{Tq ep etues 99 *sz10zJFe,p nod oenb 


quoj ou sTeTSuy SseT ‘[Tei9gUes UY ‘epuodeS ensue, eT AeTIed ja sipusadde 


- 98 - 


JueTnNea Tnb stTesueigq set JnojJAns 3s9,9,, :JueTpNza un,p sjow set uoTas 
*TTeAelq ne steT[Zue,[ ep yo stesueizy np 3n}eIs aT 2AQqua sot AsnfuT suTeqis95 
oun, p adUeSTX9,T Ans Tssne Jo sensuT{[Tq Jueze ewmMoD saTjJTIUepT sezsod 
SeT suep sfTeTZue,[ op a8esn,[ ins 980i11ejuT suaM ap 3noj 4se,s UO stew 


uotTjsenb 33300 op saitdsut jJuos os saiteqjuommod ap nod sagij 


epuodsss onsuelT eT ep osesy (2 


*saqztoedes saadoad 

ses uojTes ‘euy 341 ovaidoid uos e Jessaisoid ap gsysedme 4Te}a9 NPTATpUT,T[ no 
‘ensuetT oun eipueidde inod ue un,p astnbeieiad spotied e{[ deAe pi0odze,p 
sed 37e]9,U uQ “ST[qQe}e-aad xneaATU SOT Je SITWIT 93ep eT JueUISD 


-uod SoitejUemmo0ds saenbtTenb ATeITIOTTe sow1zou sap uofpyAsenb ey 


Sowion (q 


“auoydoouesjz CT Jo oUOYdOTSUe UOTIDeS eT eB sQuUOp spuUo; 
SOT o1}Ue vATeJa3pnq soTAsnfuyT euTeqiad sun, p soUeqSTxXe,T e ATeAOID UO 


no ‘eme}}0 & WNBueT ep 2TOI9,T e& eJaiodde1r 9s ati08a}ed 93399 


Spuoj Sep uoTATI1eday (e 


*apuod9s onBuet eT op 
agesn ‘ja fsouzou fspuoj sop uoTATIAedai :saTI089zeD SfTo1} US SaSTATP 


quOoS oUsSTNZUT[TG Np UoTINdaxKs Us OSTW eT ANS saATeJUSMMOD soy 


*SoiTejuemmM0D ap eiquou oT 

SUBP BIUeTIFJTP 9}3}0U ouN ajeJsuOD uo ‘SsuoYydOT3Ue aj09 Np seazzZTYyO xne 
sonbtj4stjzejs sed arteduod uo Tg *(Z9T) seq sn{d owgm ATeIa sB8equedanod aT 
‘TegzquOW eB faeUSTNSUTTTq eT ins gjUeMMOD e [TeI0O} UOTTFIUeYIa,T ap YOZ ep 
SUTO ‘Saitejueum0s ep dnooneseq iT}A10ssei1 JTestez nb Jefns un AtTeIa,uU 


uoT INIsxXe Us astTuM es Tu SenbtyTTod es Tu SsusTNsuT{TtTq os] 


ousTNsUTTTA OT T°Z°T'S 


ensue] op Saino) Us souoydooueig sjUeTpNjyg Sep SerfequeMMI0D Z°T'S 


- G8 - 


TABLEAU VII 


Résumé des commentaires des éléves 
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Le fait d'étre obligé d'apprendre une langue seconde provoque des 
sentiments négatifs. ty, 32 


Les @léves pensent qu'une pression est exercée sur eux parce 
qu'ils savent que leur "carriére est un jeu", et ils ont par 
conséquent peur de l'avenir. 14 26 


Beaucoup ont des complexes d'infériorité, de frustation et 
d'humiliation. ; 10 19 


Une impression d'ennui et de non-créativité et un manque général 
d'intérét sont souvent provoqués par la passivité qu'engendre 
nécessairement le dynamisme du milieu de travail. 9 17 


Certains @léves ont l'impression d'@étre perdus dans ume grosse 
machine. 2 4 


La formation linguistique est une "vacance", pas vraiment du 
travail. 1 Z 
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Tableau VI (suite) 


Nombre de Pourcentage de commentaires 
COMMENTA IRES commentaires des é@léves anglophones sur 
sur la question le personnel des écoles de 
langues 
Les opinions politiques sur le séparatisme ne devraient pas avoir 
leur place en classe. 3 5 
Les animateurs pédagogiques devraient surveiller plus étroitement 
les professeurs. 3 ») 
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Résumé des commentaires des é@léves anglophones 
sur le personnel des écoles de langues 
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COMMENTAIRES commentaires des @éléves anglophones sur 
sur la question le personnel des écoles de 
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En plus de posséder une connaissance suffisante de leur propre 
langue, les professeurs devraient @tre bilingues afin de résoudre 
en anglais les difficultés des é@léves. 15 2 
Les administrateurs n'écoutent pas les éléves et ont ume attitude 
négative envers les progrés et les problémes des éléves. 10 16 
Les professeurs possédent des qualités trés différentes. ) 14 
On change trop souvent les professeurs. 9 14 
Les conseillers pédagogiques devraient parler anglais afin d'aider 
les éléves. 5 7 
Il faudrait que les professeurs aient plus de connaissances et 
fassent preuve de plus de souplesse en ce qui a trait a 
l'utilisation du matériel et des méthodes, a 1l'évaluation des 
éléves et a la fagon de résoudre leurs problémes. 4 6 
Certains professeurs semblent avoir ume attitude "fermée". 3 b) 
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Les professeurs devraient consacrer plus de temps a leurs éléves 
aprés les heures de cours et essayer de leur inculquer certaines 
notions de la culture canadienne-frangaise. 3 5 


*uoTjeoTunuMO0D eT e dnooneaq INU NeaeATU 99 eB oUMSTNBUT[Tq ap 

enbuew aT onb osued ug ‘steTsue sed jueTied au sanbtT8o08eped saneT{[tesuos 
sep qaedn{td e[ onb suuop juej29 sowetqoid sanetT Jo ona op squtod sanetT 
eAqyTeuuod eATezy & BI[NOTIJJIP eT ep JueANOS uO sTT ‘sn{td aq ‘saAtSap saneT 
eB 329 suTOSeq sine, e uoTIUez}e Zesse sed o}zeQA1d ou uo,nb Jussued sangTta sey 
*JUPTTTeAINS eT Jo SaAeTe SeT 21}Ue UOTJeOTUNMMOD op enbuew aT 9132 eTques 


QdUeT[TeAAINs op Touuosied s~T JYUeUAS.DUOD |a[NOTFJIp etedtoutad ey 


*sinod ap sainey 

SeT seide saeAetTe sine, e sdwej op sn{td JueTeroesuod sinesseyoad sat Ts 
SegioTTewe e139 JUeTeiinod soAgTs-sAnessejoid suotje[e1 set aonb ssuad ud 
*S8AVT2I SOT JeAe SUOTIeTe1 Sep NO sTZoTOpoyjsW eT Oop saouessTeuUOd ap 
juoumestjjns sed jueke,u seijqne,p ‘sensoZ3eped suoq sai} ep juezg sun—senbtenb 
‘saquetTasjIp seaqz saqttenb sep juepessod sanessajoid set enb esuad uo 
*‘aizesseoau 3se,9 puenb steTsue JoTaed yTeanod inessezoid e—[ Ts saazTAa 
suoTjeijsniajz sep yo sotuetde e139 JUeTetinod saj[NOTJFIp sasnerzquou ep anb 
Je SoenBuUTTTq 2132 JUeTeIAep sjueINqep ep sinod sep sanessejoid sat onb 
quosued saaetTa sey ‘*‘saneassajoid set JUeTeurI0U0D Si9T} xNep seT suTOoW ne 
qUOp SseiTe}UeMMOD sep soUeT[TeAANS ep [Teuuosied eT Jo SAinessajyoid sat ans 
3Tey WUO STT ‘suTOWURaN ‘*ensuUeT ep SeTOdg sep Teuuosied np jTejstTjes 


zesse juoS SovgTa sat onb aTquwes TT ‘eTeiguas uoSejz oun, 


ansueyT ap SeTOIg Sap Touuosieg (p 


TABLEAU V 


Résumé des commentaires des él 


sur les tests et l'éva 


COMMENTA IRES 


Les tests ne révélent pas vraiment la capacité de communiquer mais 
plutét de parler et de comprendre rapidement. La vitesse exigée 
est exagérée comparativement au débit d'ume conversation normale. 


Les tests de laboratoire ne sont pas naturels et provoquent des 
inquiétudes injustifiées. 


Le but du programme de formation linguistique semble @tre de 
préparer les éléves 4 réussir des tests plut6t qu'a devenir 
bilingues. En fait, le terme "officiellement bilingue" signifie 


"réussir des tests". 


On devrait donner des points pour la participation des éléves aux 
cours. 


On devrait pouvoir subir de nouveau 1'ECL. 


L'ECL devrait relever de l'école des langues et on devrait 
discuter des résultats avec 1'éléve. 


moiwalls 


eves anglophones 
luation 


Nombre de 
commentaires 
sur la question 


18 


US) 


rl 


51 


Pourcentage de commentaires 
des @léves anglophones sur 
les tests et 1'évaluation 


35) 


Zo 


21 


10 
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100 
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TABLEAU IV 
Résumé des commentaires des éléves anglophones 
sur la méthodologie des cours 


Ce EEE 
Neeeeeeee eee ee Te. a —————————————— 


Nombre de Pourcentage de commentaires 
COMMENTAIRES commentaires des @éléves anglophones sur 
sur la question la méthodologie 


oe Ee SE ee 


Les activités des classes devraient étre plus variées. Les cours 
sont trop structurés. is 19 


On devrait prévoir plus de travaux de laboratoire. Le labo 
devrait @tre une "salle de travail" et non une "salle de test". 13 16 


Les cours devraient @tre axés davantage sur la langue parlée. 10 13 


Les cours devraient comporter plus d'explications grammaticales et 
utiliser une méthode plus traditionnelle. 10 13 


Il faudrait porter une attention plus personnelle aux éléves étant 


donné que les groupes ont tendance 4 fonctionner mécaniquement. 8 10 


Les cours ne répondent pas aux besoins des éléves; on devrait 


insister davantage sur les connaissances qu'un éléve devrait posséder. 7 9 
Les cours comportent trop de mémorisation et de simples répétitions. 6 8 
Les cours devraient prévoir plus de travaux pratiques. 5 6 


On devrait mieux utiliser le matériel audio-visuel et il devrait 


€tre possible de l'utiliser a la maison. 3 4 


Il faut plus de travaux pratiques et de meilleure qualité. 2 Z 


Neen eee eee eee eee eee 


Total 79 100 


LL 


*TONSTA-OTpne [eTAgIeW OT AaST[TIN xnetu ja 

sonbtje1d xneaeij ap sntd aeuuop ‘seAeTg xne oeT[Teuuosied sntd uotqjusz3e oun 
Jejiod :sesse{[o sop saqtTaAt oe SeT AeTAeA ap uTje suotTjse3sns sanotsntd 
ateyj e@ uO ‘essatTdnos ap je azeTAeA op onbuew uN,p JUeTeAzJnos sasseTo 

Sep SQ3TATIIP set ‘juenbasuod aed enb Jo sTouuosied sutoseq sinaT e sed 
Jtepuodez au stwnos juos soaagtTa sop oTTenbe,T e otet[notqzied epoyjyaw et onb 
uotutdo,[, izowradxe snoj jueTeTques STT ‘3 TSI2ATP ANeT sAsTew ‘stTojsazno] 
*S9ITOJOTpeajquoo ned enbjTenb jueANOS Je Sa8TAIPA JUaeTeJa SaiTeqUomOD 

sey ‘*que0 *d gf op uotjzazodoid oun suep eTZoToOpoyjeW e[ JUaTeuAadUOD 


anbtTAsTNsuT[ uotzew1zoj; op oumeraZoid s{T Ans soeAtejueuMod say 


BTSOTOpoyIaW = (4 


Tableau III (suite) 


nn 8 8 eS eS eee 


Nombre de Pourcentage de commentaires 
COMMENTA IRES commentaires des @léves anglophones sur 
sur la question l'administration des écoles 


de langues 


Il faudrait améliorer les conditions des classes et 1'emplacement 
des é@coles. 7 3 


Il faudrait des répits occasionnels afin de diminuer la fatigue et 
1' impression de saturation. 6 be 


Il est souhaitable que l'apprentissage du francais s'oriente 
davantage selon un contexte culturel. 4 2 


La teneur des cours (les films de Dialogue Canada) est sexiste. S) 1 


Il faudrait tenir davantage compte des besoins et des problémes 
personnels des éléves. -Problémes familiaux, etc. 3 1 


On devrait donner plus de renseignements en anglais aux nouveaux 
éléves quand ils arrivent aux é@coles de langues. 2 1 


On devrait donner plus de renseignements dans les écoles afin que 
1'éléve puisse entretenir de meilleures relations avec son bureau. 1 1 


La durée du cours devrait dépendre de la connaissance de la langue 


francaise acquise antérieurement ou de la norme 4 atteindre. 1 Z 


Sz 


TABLEAU III 


Résumé des commentaires des éléves 
anglophones sur 1l'administration des écoles de langues 


Nombre de Pourcentage de commentaires 
COMMENTA IRES commentaires des é@léves anglophones sur 
sur la question l'administration des écoles 


de langues 


Il faudrait grouper plus soigneusement les éléves d'une classe. 4l 7 
Ces personnes pourraient @étre groupées selon: 

-les relations antérieures avec des éléves francophones du groupe, (18) 7 
-la personnalité, 1'age et la motivation, (14) 6 
-les normes que doivent atteindre les é@léves du groupe. (69) 4 


Les bandes magnétiques sont de mauvaise qualité et il est 
difficile de bien comprendre. 36 15 


Les classes ne devraient pas compter plus de 5 ou 6 personnes. 28 12 


La durée prévue d'un an est trop courte et provoque de 
l'inquiétude. De plus, le rythme est trop accéléré. 14 6 


On a suggéré d'offrir plusieurs méthodes pédagogiques au choix. 14 6 
L'immersion devrait @tre plus totale et on devrait placer les 
éléves dans des foyers ou dans des écoles situées dans un milieu 


francophone. 12 5 


Des classes de rattrapage devraient @tre organisées afin de 
résoudre des difficultés précises d'apprentissage. 9 4 


Il faudrait prévoir des vacances au cours de la période de 
formation linguistique. 9 4 
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TABLEAU II 


Résumé des commentaires des 
éléves anglophones sur le processus d'orientation 
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Nombre de Pourcentage de commentaires 
COMMENTA IRES commentaires des é@éléves anglophones sur 
sur la question le processus d'orientation 


ee ee 


Les entrevues d'orientation précédant le cours provoquent de 
l'inquiétude et sont décourageantes et démoralisantes. En résumé, 


elles ne fournissent pas la motivation positive nécessaire a la 
formation linguistique. De 43 


On devrait fournir plus de renseignements aux é@léves concernant le 


niveau A atteindre et les méthodes utilisées pour la formation 
linguistique. 16 31 


Il faudrait avoir un bref cours sur la grammaire anglaise avant de 
commencer le cours de langue frangaise. 5 10 


Il faudrait suivre de plus prés les éléves aprés leur formation, 
peut-étre au moyen d'entrevues. 5 10 


Il faudrait avertir plus t6t les éléves de la date du début de 
leur formation linguistique. 5 6 
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Tableau I (suite) 


a 


Nombre de Pourcentage de commentaires 
COMMENTA IRES commentaires des éléves anglophones sur 

sur la question le bilinguisme 

Les gens sont obligés d'apprendre le francais afin de ne pas 

perdre leur emploi. 12 4 

Le bilinguisme est strictement une question politique. i 2 4 

C'est ume erreur d'obliger tout le personnel de surveillance 4a 

devenir bilingue. 8 3 

On peut se demander s'il est opportun d'obliger des personnes qui 

sont presque a 1'age de la retraite a devenir bilingues. 8 a 

On ne devrait pas refuser une promotion a quelqu'un parce qu'il 

n'a pas les aptitudes nécessaires pour apprendre une langue 

seconde. i Z 

L'identification de postes bilingues devrait é@tre faite-selon les 

exigences de chaque poste, non selon la catégorie de l'emploi. 5 Z 

La durée et le niveau de la formation linguistique devraient 

dépendre du degré d'utilisation du frangais dans un emploi. 4 1 

Il est nécessaire d'organiser des unités bilingues afin de veiller 

a l'utilisation du frangais au travail ou pendant la formation en 

cours d'emploi au Québec. 2 1 


Total 297 100 


TABLEAU I 


Résumé des commentaires 
des @léves anglophones sur le bilinguisme 


Nombre de Pourcentage de commentaires 
COMMENTA IRES commentaires des éléves anglophones sur 

sur la question le bilinguisme 

Les fonds du fédéral devraient servir a financer les programmes de 

formation linguistique dans les écoles primaires et secondaires. 66 22 

Le frangais acquis a la formation n'est pas tellement utilisé dans 

le milieu de travail. 59) iM) 

L'identification de postes bilingues est faite d'une fagon 

exagérée, confuse et irréaliste. C'est essentiellement une 

question de chiffres. 40 3 

Le cout du bilinguisme est excessif. a 10 

Les renseignements disponibles sur lesquels on pourrait se fonder 

pour l'identification de postes bilingues sont insuffisants. En 

fait, les postes ont été désignés bilingues 1a ou le milieu de 

travail est anglais. 20 6 

"Le bilinguisme fonctionnel", c'est-a-dire la notion de niveaux de 

bilinguisme, est politique et irréaliste; on est ou on n'est pas 

bilingue. 18 6 


Les promotions devraient @tre fonction des aptitudes personnelles 
et non pas de la possibilité de parler ou d'apprendre une langue 
seconde. T3 a 
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